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CHAPTER I 

THE PROBLEM, DEFINITIONS, AND LIMITATIONS 
Introduction 

In 1969 new textbooks in reading and literature were 
implemented in the elementary schools of California. The 
textbooks were adopted and implemented after a period of 
three years of careful planning. The first steps in plan- 
ning began in the spring of 1966 when experts in reading from 
California colleges and universities convened to consider the 
criteria for a new reading adoption. By early 1967 criteria 
were approved by the State Board of Education. According to 
the criteria, the adopted reading program should: (1) build 
positive attitudes, (2) develop efficient reading skills and 
lifelong habits of reading critically and creatively, (3) 
bridge cultures and divergent socioeconomic segments, (4) 
provide for a wide span of abilities, (5) provide for the 
diagnosis and correction of reading disabilities and for the 
evaluation of student progress, (6) possess a scope and se- 
quence of all reading skills in a balanced program (103:46). 

Point (3) above was included in the criteria because 
the State recognized the student population of California 
schools was composed of children from many backgrounds; the 
student population came from different racial, ethnic. 
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cultural, and socioeconomic backgrounds. Figures for racial 
and ethnic groups in 1966 appear in the State's justifica- 
tion Statement and are reported below in Table 1 (103:7). 

TAELE 1 

ENROLLMENT IN CALIFORNIA ELEMENTARY SCHOOLS, 
BY RACIAL AND ETHNIC GROUPS, FALL 1966. 

Number Percent 



Spanish Surname 


380,909 


13.99 


Other White 


2,046,800 


75.20 


Negro 


214,126 


7.80 


Chinese, Japanese, Korean 


53,713 


1.97 


American Indian 


7,976 


.29 


Other Nonwhite 


18,101 


.66 


Total 


2,721,625 


99.91 



From this data the State concluded ±t had a student 
population that ranged widely in learning rates, learning 
styles, ability to understand and express themselves in Eng- 
lish, and in reading interests (103:6-8). The State further 
concluded that reading textbooks should be adopted to accom- 
modate this diverse student population. Thus, Section 9311 
of the Education Code was enacted into law by the Legislature 
to accomplish that purpose; for it required the adoption of 
more than one basic textbook (105:586). 

Socioeconomic data were not stated for the groups in 
Table 1, or in any part of the justification Statement (103). 
Instead, 15 per cent of the population in Table 1 was 
labeled "culturally disadvantaged" by the State Office of 
Compensatory Education (103:9). The culturally disadvantaged 
and three additional student groups were identified and 
described in the four paragraphs that follow. Reading 
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textbooks were then adopted for the four groups of students 
described below: 

Culturally Disadvantaged Group 

Pupils whose score on the most recent reading test 
does not come up to the expectancy level determined 
by teacher judgment based on performance in the class- 
room and/or other test scores available, and who, in 
the opinion of the teacher, have such low reading 
achievement because of economic, cultural, social, 
or language backgrounds and resultant language dis- 
abilities or other disabilities, are in the cultur- 
ally disadvantaged group. Pupils who did not take 
such a test within the year, but who in the opin- 
ion of the teacher indicate by their classroom per- 
formance that they fall in the culturally disadvan- 
taged group, will be considered to be within the cul- 
turally disadvantaged group. Fifteen percent of the 
pupils in kindergarten and in each grade of grade one 
through grade eight are assumed to be culturally dis- 
advantaged. (This assumption is based upon survey 
figures supplied by the Office of Compensatory Edu- 
cation. ) 

Lower Group (Slow) 

Pupils who scored at or below the 25th percentile 
on the most recent reading test used in the state 
testing program and such other pupils as did not take 
such a test within one year of the use of the text- 
book by the pupil but who, in the opinion of the 
teachers, would, if given such a test, achieve a 
score within this percentile range, are within the 
lower group. 

Middle Group (Average) 

Pupils who scored from the 26th to the 75th per- 
centiles on the most recent reading test used in the 
state testing program and such other pupils as did 
not take such a test within one year of the use of 
the textbook by the pupils but who, in the opinion 
of the teachers, would, if given such a test, achieve 
a score within this percentile range, are within the 
middle group. 
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Upper Group (Fast) 

Pupils who scored above the 75th percentile on the 
most recent reading test used in the state testing 
program and such other pupils as did not take such 
a test within one year of the use of the textbooks 
by the pupils but who, in the opinion of the teach- 
ers, would, if given such a test, achieve a score 
within those percentiles, are within the upper group 
(103:9-10) . 

The months from June 1967, to May 1968, were a period 
of examination and evaluation of reading textbooks, and fol- 
lowed the formulation of criteria and the description of 
groups of students. Examination and evaluation required the 
efforts of approximately 40,000 persons distributed through- 
out the State, Personnel included teachers, administrators, 
curriculum workers and supervisors, college and university 
professors, librarians, college students, laymen, and others 
(103:5). In May 1968, the Curriculum Commission for the 
State of California (and coordinating body for the adoption 
procedures) made its recommendations to the State Board of 
Education (103:1-46) . 

Statement of the Problem 

From June 1967, to May 1968, the contents of each 
reading textbook series, submitted for adoption by publish- 
ers, were examined and evaluated according to nine catego- 
ries titled: (1) readiness, (2) word attack skills, (3) vo- 
cabulary, (4) comprehension, (5) reading in the content 



fields, (6) fine literature, (7) balanced program, (8) eval- 
uation measures, (9) teacher's editions (103:13-27). 

Four textbook series, shown in Table 2 on the next 
page, were recommended for adoption in the final selection 
process (104:6-13) . Those series and the groups of students 
they were to serve were as follows: 

The Bank Street Readers , published by the Macmillan 
Company, were adopted for grades one through three and were 
deemed appropriate for culturally disadvantaged students (1). 

The Open Highways Readers , published by Scott, 
Foresman and Company, were .dopted for grades four through 
six and were deemed app/ L jriate for slow and culturally dis- 
advantaged students (16). 

The Harper and Row Basic Reading Program , published 
by Harper and Row, Publishers, Incorporated, was adopted for 
grades one through six and was deemed appropriate for aver- 
age and slow students in grades one through three and also 
appropriate for average students in grades four through 
six (14). 

The Macmillan Reading Program , published by the 
Macmillan Company, was adopted for grades one through six 
and was deemed appropriate for fast students (12). 

All of the textbook series were described in the 
justification Statement (103) by employing the nine 
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categories enumerated above. One of those categories, namely 
vocabulary, described the degree of vocabulary control within 

each of the series and the extent to which vocabulary cor- 
related with the listening and speaking vocabularies of ele- 
mentary school students. Descriptions of vocabulary usage 
were made in general and subjective, rather than in specific 
and objective terms; the statements were as follows: 

Bank Street Readers (Culturally Disadvantaged) (1) 

Vocabulary: The vocabulary is based on the content 
used in the materials and on real-life experiences 
outlined in the program. This approach allows the 
teacher to broaden and expand the child's use of 
words . 

These readers take into account the language dif- 
ficulties of the disadvantaged. In its recent re- 
por t , Language Arts Programs for the Disadvantaged , ^ 
The National Council of Teachers of English recom- 
mends greater stress on oral language for the dis- 
advantaged child at all levels of instruction. Rec- 
ognizing that these children often come to school 
with limited exposure to the words and concepts many 
children learn at pre-school age, the Bank Street 
program emphasizes at its earliest levels extended 
language experience activities in order to help 
children gain facility in oral language as well as 
to develop in them an understanding of the relation- 
ship between written and spoken words (103:24). 

Open Highways Readers (Slow and Culturally Disadvan- 
taged) (16) 

Vocabulary: Emphasis is placed on building lan- 
guage through vocabulary familiar to the child and 
from his experiences. Shades of meaning are empha- 
sized and facility with oral language patterns. In 



-Rational Council of Teachers of English, Report of 
the National Council of Teachers of English Task Force on 
Teaching English to the Disadvantaged, Language Programs for 
the Disadvantaged , 1965, p. 272. 

O 
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the beginning of the program sentences are short and 
direct but increase in complexity as the child pro- 
gresses. Dictionary sections and glossary sections 
provide opportunities for expanding and developing 
vocabulary (103:26) . 

Harper and Row Basic Reading Program (Average and 
Slow) (14) 

Vocabulary: The first grade vocabulary in the 
Harper and Row readers has been greatly expanded over 
basic reading programs now in use. Yet this expan- 
sion has been accomplished without the use of mean- 
ingless word lists, or the use of words which are 
phonetically regular and simple but which are complex 
in their meanings and associations. Meaning, includ- 
ing" multiple meaning, is stressed just as much as 
word pronunciation or decoding. The vocabulary in 
both Strands I and II reflects current research and 
scholarly thinking in the field of reading. In the 
fifth grade reader all vocabulary controls are drop- 
ped and the student is encouraged to expand and en- 
rich his knowledge of words (103:17-18). 

Macmillan Reading Program (Fast) (12) 

Vocabulary: Vocabulary in this series is unre- 
stricted and an effort has been made to include words 
from the listening and speaking vocabulary of most 
children. Unusual words have been used for immediate 
interest and utility and additional words selected to 
demonstrate phonetic or structural principles (103:21). 

In September 1973, a letter of inquiry was mailed by 
this writer to each of the three publishers of the four 
adopted series. The purpose of each was to discover which 
readability formulae, if any, had been applied in the writ- 
ing of the textbooks. If no formulae had been applied, the 
publishers were asked to explain on what bases grade levels 
had been assigned to the textbooks (Appendixes I, II, III). 
Letters of reply were received from all three publishers. 
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Harper and Row Publishers took the position that most 
readability formulae were unsuitable for non-textbook mate- 
rials and for reading textbooks; vocabulary introduced in the 
Harper and Row (14) textbooks, although considered " unfamil- 
iar " by some readability formulae, becomes familiar through 
carefully planned teaching. The bases for assignment of 
grade levels to textbooks were: interest, story excitement, 
familiarity of situations, clarity of concepts, simplicity of 
syntax, and familiarity of vocabulary (Appendix IV). 

Macmillan Publishing Company referred to the vocabu- 
lary lists and work done in reading by Dr. Albert J. Harris 
and to the readability formulae of Dale-Chall (36) and 
Spache (83); the content of that letter was nonspecific when 
referring to the works of Dr. Harris, and inaccurate when 
referring to the formulae of Dale-Chall and Spache (Appen- 
dix V). However, one can infer that the two formulae were 
applied, as appropriate: % the Dale-Chall to an unspecified 
number of intermediate-grade textbooks „ and the Spache to all 
primary-grade textbooks . 

Scott, Foresman and Company explained that each se- 
lection had been placed in a book on the basis of suitabil- 
ity. Suitability was judged according to: readability 
rating by the Dale-Chall (36) or the Spache (83) formulae, 
difficult words, level of interest, background required for 

O 
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interpretation, maturity of concepts, literary form, author's 
style, paragraph length, new vocabulary, and connectives 
used (Appendix VI). 

In summary, this writer has attempted to show that 
the justification Statement (103) did not include readability 
ratings traditionally derived by applying objective formulae 
to textbook passages. This writer has also summarized in- 
formation, recently supplied to him, about readability formu- 
lae and other readability factors weighed by publishers when 
they composed the textbooks analyzed in this study. It is 
important to state here that none of this information was 
volunteered to this writer or other committee members in 
1968, for at that time this writer was a member of a commit- 
tee to evaluate textbooks for the State of California. Com- 
mittee members were teachers employed by the Berkeley Uni- 
fied School District, Berkeley, California. In retrospect, 
the omission from the justification Statement (103) and from 
the publishers were gross and startling since readability 
formulae remain, to this day, one important source for meas- 
uring textbook difficulty. Thus, in 1968 readability data 
were not available to evaluate reading materials being se- 
lected for a heterogeneous population of nearly three million 
students. 

Briefly stated then: the purpose of this study is 
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to determine if there is a significant difference in the 
readability of reading textbooks adopted by the State of Cal- 
ifornia for four student groups in grades one through six: 
the culturally disadvantaged, the slow, the average, and the 
fast. A further purpose is to recommend procedures teachers 
should follow when assigning reading textbooks to students 
on the basis of readability data. 

Need for this Study 

After reading the vocabulary sections in the justi- 
fication Statement this writer concluded that the evaluation 
of vocabulary in the four series of textbooks had been ex- 
pressed in highly subjective and general terms (103:17-18, 
21, 24, 26). The description of vocabulary used in the Bank 
Street Readers (1) and in the Open Highways Readers (16) led 
this writer to expect that text descriptive of real-life ex- 
periences and utilizing the syntax of spoken language would 
deviate significantly from the syntax in other reading text- 
books; thus, vocabulary would differ measurably from other 
textbooks. The description of vocabulary used in the Harper 
and Row (14) textbooks led this writer to anticipate that an 
expanded vocabulary for grades one through three, and an 
elimination of vocabulary controls at grade five, would yield 
textbooks more difficult than the grade assigned them by the 
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publisher; thus, perhaps the textbooks would be even more 
difficult than the Bank Street Readers and Open Highways 
Readers . And last, this writer should anticipate that the 
Macmillan (12) textbooks, adopted for the fast group, would 
be significantly more difficult than the other three series 
because vocabulary controls had been eliminated for all 
textbooks in that series. In general, this writer antici- 
pated that the readability levels of the four series of 
textbooks would be higher than the grade levels assigned by 
their publishers. Other important, but as yet unknown, 
differences were also expected to emerge from among the four 
series of textbooks. The above inferences are to be verified 
in this study by securing answers to the following five 
questions : 

Is there a significant difference in the readability 
levels of three collections of reading textbooks adopted by 
the State of California for culturally disadvantaged, slow, 
average, and fast students? 

Is there a gradual increase in the readability levels 
within each of the three collections of textbooks, starting 
with textbooks for grade one and continuing through textbooks 
for grade six? 

When nine, 100-word samples are drawn from each text- 
book, will the readability levels of the samples increase 
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gradually, starting with the first sample and ending with 
the ninth sample? 

Does the range of readability levels of samples 
drawn from textbooks vary from book-to-book within each of 
the three collections of textbooks, starting with the text- 
book for grade one and continuing through the textbook for 
grade six? 

Is there a difference in the range of readability 
levels of samples drawn from the three collections of text- 
books, starting with a comparison of all textbooks for grade 
one and continuing through all textbooks for grade six? 

Hypothesis 

The first question in the preceding section has been 
restated in the form of the null hypothesis to be tested in 
this study: There will be no significant difference found 
in the readability levels of three collections of reading 
textbooks adopted by the State of California for four student 
groups (culturally disadvantaged, slow, average, and fast). 
Readability levels are to be measured with the Botel (2) 
formula. The remaining four questions will be answered 
through descriptive analyses of the data within the frame- 
work of the descriptive/statistical design of this study. 



Definition of Terms 



For the purpose of this study the following defini- 
tions of terms have been adopted: 



Textbook: 



Textbook series: 



Three collections : 



Readability level: 



a book used in the study of 
reading . 

a group of books written 
for reading instruction by 
one publisher and desig- 
nated for a range of school 
grades . 

four textbook series organ- 
ized for four student 
categories ; culturally 
disadvantaged , s low , 
average, and fast. 

a statement of comparison 
of Vocabulary contained in 
reading material with vo- 
cabulary contained in a 
selected word list. 



Limitations 



All generalizations made from this study must ob- 
serve the following parameters circumscribed by the design 
and content of this study: (1) vocabulary is the sole 
variable utilized in the determination of readability level, 
and (2) the Botel (2) formula may be inappropriate for 
measuring the readability levels of textbooks other than 
textbooks for reading instruction. 



Suirjnary 

Adoption procedures and adoption criteria have been 
described in this chapter. The problem has been described/ 
and questions have been posed which require answers. 

Literature related to the topic of readability will 
be reviewed in the next chapter . 



CHAPTER II 



REVIEW OF THE LITERATURE 

Readability Defined 

An initial discussion of the topic, readability, 
with a group of teachers or laymen has the possibility of 
eliciting three categories of responses. Some persons in 
the group may launch into a discussion about the legibility 
of handwriting or typography as their perception of the com- 
ponents of readability. Other persons in the group may dis- 
agree and state that legibility is not so important as the 
in teres t-value of what is being read. Still, other persons 
in the group may point up the importance of ease of under- 
standing (comprehension) due to style of writing. It is not 
the intent in this chapter to attempt to maintain the sharp 
lines drawn by members of the imaginary group, above; in- 
stead, the intent is to establish a broader frame of ref- 
erence as a point of departure for this study. That frame 
of reference is to be found in the definition of readability 
by Gilliland. He defined readability in terms of matching 
the reader with materials: 

Readability is primarily concerned with a basic prob- 
lem familiar to all people who choose books for 
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their own use or who choose books for others to use. 
This is a problem of matching. On the one hand 
there is a collection of individuals with given in- 
terests and reading skills. On the other hand, 
there is a range of books and other reading mate- 
rials, differing widely in content, style and 
complexity. The extent to which the books can be 
read with profit will be determined largely by the 
way in which the two sides are matched. For example, 
a person who is a competent reader may soon be de- 
terred from reading if his choice is restricted to 
simple repetitive texts. Similarly, a person with 
limited reading ability may soon become discouraged 
if he is given texts which are beyond his compre- 
hension. . . . The study of this problem of match- 
ing reader and text has come to be called 'read- 
ability 1 (9:12). 

A widely quoted definition by Dale and Chall is prob- 
ably also useful for this study even though it appears nar- 
rower in scope, less specific in detail (and therefore less 
practical for application); nevertheless, its value contin- 
ues : 

In the broadest sense, readability is the sum total 
(including interactions) of all those elements within 
a given piece of printed material that affects the 
success a group of readers have with it. The success 
is the extent to which they understand it, read it 
at an optimum speed, and find it interesting (37:23). 



Ecirliest Concerns 



Early religious writings evidenced an interest in 
readability (or its parallel, listenability ) . Advocates of 
clear language made their point in I Corinthians 14:9, "Ex- 
cept ye utter by the tongue words easy to be understood, how 
shall it be known what is spoken? For ye shall speak into 
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the air." First recorded attempts to examine readability 
were made by religious teachers, the Talmudists, in 900 A.D. 
They counted words and ideas to determine frequency of occur- 
rence ; from this they could distinguish the usual from the 
unusual meanings and divide the reading of the Torah into 
weekly portions of approximately equivalent comprehension 
units (64:544). 

In this century William S. Gray, as reported by 
Klare, explained that vocabulary was considered a factor in 
the ease of understanding when McGuffey Readers were ana- 
lyzed in 1840 and graded from easiest to hardest (57:14). 
F. W. Kaeding, a German, constructed a word count in 1898, 
provided a more scientific base for relating vocabulary to 
reading difficulty, and established the first vocabulary 
list (64:545). Then in 1921 Thorndike tabulated the fre- 
quency with which words occur in print and published The 
Teacher 1 s Word Book (18). That publication influenced the 
teaching of vocabulary in schools; later it also served as a 
basis for measuring readability in the first readability for- 
mulae. 

Formulae Emerge 

The term 11 readability formula" will be used in this 
study to refer to a 11 • . . method of measurement intended 
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as a predictive device (13:13)." 11 ... a readability for- 
mula is a method of estimating the probable success a reader 
will have in reading and understanding a piece of writing 
(13:34)." The years of 1923 to 1934 were a period of the de- 
velopment of the first readability formulae in the United 
States . 

The first readability formula evolved in 1923 when 
Lively and Pressey sought to discover the comparative vocab- 
ulary burden in textbooks, and also sought to measure the 
vocabulary difficulty in supplementary reading material. 
They sampled one-thousand-word passages and tabulated the 
number of different words in the sample and their frequency 
of occurrence. Then they assigned value to each word as 
given in Thorndike's Teacher's Word Book (18) and deter- 
mined words not appearing in that book. Thus they developed 
a formula for determining readability (62). 

The Lively and Pressey effort was followed by a 
large study of the reading preferences of 37,000 students by 
Vogel and Washburne. Reading preferences were matched with 
scores on a reading achievement test. The median reading 
grade scores were computed on 152 preferred books and were 
then used as a grade level rating for each of the books. 
These grade level ratings were then correlated with scores 
from the Lively-Pressey (62) formula. A correlation 
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coefficient of .80 was obtained. The work of Vogel and 
Washburne was significant not only because it was the first 
validation study of a formula element using outside crite- 
rion, but it also provided a base for these authors to con- 
struct a new readability formula (89). Klare observed: 

Their technique, . . . , is of special interest be- 
cause it represents the prototype of modern read- 
ability formulas. 

This formula is of particular importance because, 
in addition to its modern appearance, it yielded 
scores that correlated .845 with the reading test 
scores of the children who read and liked the crite- 
rion books (13:39). 

Dolch (40), Lewerenz (60, 61), Johnson (54), Bear 

(95), Patty and Painter (74), and Thorndike (88), were some 

of the other investigators involved in readability rest arch 

during this eleven-year period; readability research relied 

heavily upon vocabulary variables for predicting readability, 

upon Thorndike' s Teacher's Word Book (18) as a basis of 

vocabulary difficulty, and upon the use of relatively crude 

criteria of reading difficulty, including polysyllabic word 

count and weighted-word formulae. Only minimal efforts. were 

made to validate results (13:44). 

The next period from 1934 to 1938 was marked by a 

diminished reliance on vocabulary lists like Thorndike 1 s 

(18); in its stead, an interest emerged in variables such as 

sentence length and complexity, qualitative aspects of 



vocabulary usage, and variety in parts of speech represented 
in a passage. Interest shifted to the development of read- 
ability formulae applicable to adult reading materials (13; 
44-51). Noteworthy examples of researchers during this 
period are Ojemann (72) , Dale and Tyler (38) , McClusky (66) , 
Gray and Leary (49), and Morriss and Halverson (102). An 
era of the so-called, efficient formulae, followed. 

The period from 1938 to 1969 witnessed a shift in 
emphases in so-called, formula-making (13:51-81). The shift 
was from the complex to the simple and more efficient. This 
was perhaps a natural reaction after some fourteen years of 
experience with formulae that appeared to increase in com- 
plexity with the passage of time and with mounting research 
evidence. Thus, during the three decades that followed, 
readability formulae became more efficient by reducing the 
number of variables in them. Some of the older formulae 
currently in use, and more recent formulae, have been 
charted in Table 3 on the next page. The most recently de- 
veloped formulae, by Fry (45) and McLaughlin (68), have 

« 

stressed efficiency, that is, ease of calculation and sav- 
ings of time. Pauk estimated the calculation time for the 
McLaughlin formula to be about ten minutes and fifteen min- 
utes for the Fry formula (75:207). 

During the same thirty -year period there was another 
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TABLE 3 

SELECTED READABILITY FORMULAE DEVELOPED 
DURING THE YEARS : 1938-196 9 



Author /Year 



Range of 
Difficulty 
(Grade) 



Var iables 



Lorge, 1939 (63) 



Flesch, 1948 (44) 



Dale and Chall, 
1948 (36) 

Yoakam, 1951 (94) 

Farr, Jenkins, and 
Paterson, 1951 (43) 

Gunning, 195 2 (10) 



Spache, 1953 (83) 

Botel, 1962 (2) 
Fry, 1968 (45) 

Elley, 1969 (41) 
McLaughlin, 1969 (68) 



3-12 



3-12 



3-12 

2-14 
Adult 

6-12 

1-3 

1-12 
1-Col. 

Age: 7-14+ 
7+ 



Sentence length 
Prepositional phrase 
"Hard" words 

"Reading Ease" 
Sentence length 
Syllable count 

"Human Interest" 
Personal words 
Personal sentences 

Sentence length 
"Hard" words 

"Hard" words 

Monosyllables 
Sentence length 

"Fog Index" 
Sentence length 
Polysyllables 

Sentence length 
"Hard" words 

"Hard" words 

Sentence length 
Syllable count 

Noun frequency count 

"SMOG" 

Polysyllables 



trend, namely, to develop formulae for limited areas (13:66) 
for example, the Spache (83) for grades one to three, the 
Dale-Chall (36) for grades four and above, the Flesch (7) 
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and Bloomer (24) for assessment of levels of abstraction, 
and the Botel (2) for vocabulary common to textbooks de- 
signed to teach children how to read. The suitability of 
formulae for limited areas was validated in 1973 by 
Felsenthal in a study designed to compare readability esti- 
mates of four formulae by utilizing a computer. The Spache 
was concluded to be best for primary grades, the Lorge (63) 
for junior high school, the Fry (45) for high school, and 
the Flesch " Reading Ease' 1 (44) had the broadest range of 
coverage (96:9). 

Since 1963 there has been a steady increase in the 
use of computers in readability research. In 1963 Danielson 
and Bryan derived a new formula through computer use (39). 
In 1970 Klare , and others, computerized the Flesch "Reading 
Ease" formula (58) ; Jacobson and MacDougall fused readabil- 
ity variables and programmed instruction units (51). In 
1973 Moe and Arnold ascertained the readability of Newbery 
Award Books through computer use (101); and Harris devel- 
oped a new readability formula utilizing a computer (99). 

Cloze Procedure 

In 1966 Bormuth criticized the quality of readabil- 
ity formulae. He stated: 

It is problematic whether presently available 



readability formulas help more than they hinder. 
Because these formulas are easy and inexpensive to 
apply 4 :hey enjoy widespread use by publishers and 
educators (27:81) . 

Three years earlier in 1963 Bormuth wrote passages at three 
different readability levels as computed with the Dale-Chall 
(36) formula. A cloze test on each passage was given to 
children in grades four, five, and six. Bormuth concluded 
that the cloze procedure was a measure of readability, and 
that cloze tests were valid and reliable predictors of com- 
prehension (25:134). Gallant (47), and others, later veri- 
fied those conclusions. 

The cloze procedure (or technique) had been devel- 
oped ten years earlier by Taylor in 1953. The term, "cloze," 
was derived from the term, "closure." Taylor explained: 

The . . . term is one Gestalt psychology applies to 
the human tendency to complete a familiar but not- 
quite-finished-pattern to 'see' a broken circle as 
a whole one ... by mentally closing up the gaps 
(87:415) . 

When the closure theory is applied in reading to measure com- 
prehension (and some would say readability) , it involves the 
random or_ pattern deletion of words from printed passages. 
As Lamb described it — 

Subjects are asked to fill in the blanks with the 
exact word deleted. The difficulty rating for a 
passage is determined by counting the number and com- 
puting the percentage of blanks filled in with pre- 
cisely the same word used by the original writer 
(100:6) . 
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In his 1953 study Taylor compared cloze test results with 
the Dale-Chall (36) and the Plesch "Reading Ease" (44) for- 
mulae. He found that cloze scores ranked three passages in 
much the same order of readability as did the two formulae. 
He applied the cloze procedure to works of Gertrude Stein 
and James Joyce. The cloze scores indicated the passages 
were very difficult. By contrast, the two formulae ra J " *d 
the passages as easy (87:433). 

Bormuth (25) followed up his 1963 study with two 
additional investigations; his purpose was to establish 
scores for multiple-choice questions , and scores for word 
accuracy and comprehension (on an oral reading test) that 
would be comparable to scores on cloze tests- Thus, in a 
1967 investigation of cloze — multiple choice comparability, 
he concluded that cloze scores of 38 and 50 per cent were 
comparable to multiple-choice scores of 75 and 90 per cent, 
respectively (28:296-98). In a 1968 investigation of 
cloze — oral reading comparability, Bormuth concluded that 
cloze scores of 44 and 57 per cent were comparable to com- 
prehension scores of 75 and 90 per cent, respectively; and 
cloze scores of 33 and 54 per cent were comparable to word 
accuracy scores of 95 and 98 per cent, respectively (29:196). 
In 1969 Rankin and Culhane replicated the two studies just 
described and corroborated the validity of Bormuth 1 s 



scores (76 ) . 



A note of caution was interjected by Weaver and 
Kingston related to the interpretation of cloze scores. A 
factor analysis, while showing loading of cloze tests on a 
comprehension factor, also showed a clearly defined redun- 
dancy factor on which all cloze tests loaded (90:259). 
Klare stated the problem in somewhat different terms: 

In the use of cloze tests as comprehension measures 
. . . missing words can be frequently restored with- 
out an 'understanding 1 of a passage. . . . cloze 
scores may well be measures of language redundancy 
as much as of comprehension. . . . The cloze test 
. , . is . . .a reliable measure. But is it an 
equally valid measure of comprehens ion? Walter 
MacGinitie . . . raises some doubts . 2 He points out 
that comprehension has been measured traditionally 
as the ability to ask questions about information in 
a passage. This kind of measurement is not without 
problems, notably the relative effect upon compre- 
hension scores of the difficulty (and guessability ) 
of the questions (apart from the difficulty of the 
language in the passage itself). In other words, you 
can ask hard questions about easy material, or easy 
questions about hard. in the cloze test, however, 
as MacGinitie points out, missing words can frequent- 
ly be restored correctly without, what is usually 
called, an 'understanding 1 of a passage. All that is 
necessary is a recognition of familiar patterns of 
expression. That is, structure words can often be 
restored to a passage where the content words are 
only vaguely understood. Unless the blanks in the 
cloze test are appropriately selected (in much the 
same manner as test items) MacGinitie feels that 
cloze scores may well be measures of language redun- 
dancy as much as of comprehension (56:121). 

2 W. H. MacGinitie, "Comments on Professor Coleman's 
Paper." (paper presented at the Symposium on Verbal Learning 
Research and Technology of Written Instruction), Columbia 
University, 1966. 



Three years earlier in 1963 Klare wrote of the 

values of cloze procedure: 

The cloze procedure is not a formula (even though it 
might 'predict 1 difficulty for a large group of 
readers based on results from a smaller sample). It 
is, however, a quick, easy and versatile testing 
technique that may well be used for developing cri- 
teria in the construction and validation of read- 
ability formulas (13:85). 

Some limitations of the cloze procedure are obvious 

for example, it is all but impossible to determine the read 

ability of a book for these practical reasons stated by Fry 

Were it not for the enormous amount of time this 
method takes, cloze procedure would be an excel- 
lent way to determine readability. In addition to 
the time it takes to make cloze passages, a number 
of different passages must be tested at the same time 
on the same group of children. One cannot return to 
the same group of children several monthp later, for 
their reading abilities will have changed and the 
cloze error scores will not be comparable. As a re- 
search tool the method is excellent but for prac- 
tical purposes it is all but impossible to use (46: 
536). 

Lamb summed up the merits of the cloze procedure in 

a recent statement? 

While Cloze tests do not constitute a readability 
formula in the narrowest definition of that term, 
they do have the advantage of looking at the total 
linguistic structure of a selection which most read- 
ability formulas do not, . . . Cloze tests also pro- 
vide important evidence regarding the level at which 
a given passage is understood (100:7). 

Linguistic Structures 



Linguistic structures (words , clauses , sentences , 



longer passages) have been investigated by persons inter- 
ested in the comprehension of the same by speakers, readers, 
and writers of English. These investigators have pursued 
readability studies or related studies to determine those 
linguistic structures which impede or facilitate comprehen- 
sion. The application of cloze tests in research design, as 
noted in the previous paragraph, has afforded opportunities 
for examining the linguistic structure of a passage and its 
comprehensibility . Selected studies will be reviewed in 
this section; the studies will survey some of the aspects 
involved in the comprehension of linguistic structures by 
speakers, readers, and writers of English. 

Three studies of word depth are described here. 
Yngve analyzed and diagrammed the structure of sentences. 
He hypothesized that more complex sentences impose a greater 
strain on the memories of the speaker and the listener. The 
amount of memory storage necessary to produce a sentence was 
called the "depth" of the sentence. Yngve assigned numeri- 
cal value to each word according to its depth (position) in 
the sentence. The importance of this model for readability 
studies lies in the fact that it offered a means of assess- 
ing the complexity of sentences which can be expressed nu- 
merically (93). Botel, and others, developed a formula for 
evaluating complexity of syntax. The formula has been based 



on a theory of transformational grammar, experimental data 
on children's processing of syntactic structures, and lan- 
guage development including performance studies of oral and 
written language of children. Syntactic structures have 
been assigned numerical values; values increase as the com- 
plexity of syntax increases (4). Bormuth tested a word-depth 
method of measuring grammatical complexity of sentences to 
see if the method could be used to predict the difficulty 
children have in comprehending printed materials 1 . A com- 
puter assigned a number to each word as a measure of depth. 
From this effort Bormuth inferred that the word-depth meas- 
ure was a powerful predictor of comprehension of materials 
of varying idea density or concept difficulty. He concluded 
that word depth was also a more powerful predictor of com- 
prehension difficulty than mean sentence length and propor- 
tion of hard words as measured by the Dale-Chall (36) formu- 
la (26:230). 

Studies of the linguistic structure of sentences 
have demonstrated that some structures are easier to compre- 
hend. The cloze procedure was applied to sentences to 
ascertain their comprehensibility by Aborn, and others. 
Sentences varied in length, position, and type of words 
omitted. The investigators concluded that those three vari- 
ables were effective sources of constraint on words in 



sentences (20:180)* Nominalized sentences were compared, by 
means of cloze tests, to their grammatical transformations 
using active verbs. The active-verb version was more com- 
prehensible. The investigators were Coleman and Blumenfeld 
(34). Coleman replicated and expanded this study, twice. 
He found significant differences among categories of gram- 
matical transformations. The differences favored active 
verbs, nonembedded sentences, shorter clauses, and the 
shorter of matched pairs of transformations (32, 33). 

Units longer than sentences have been studied to 
ascertain their comprehensibility . Fagan studied the 
effects of the cloze procedure and four types of transfor- 
mations on the reading comprehension of pupils in grades 
four, five, and six. He concluded that sentence difficulty 
was more dependent on the presence and difficulty of trans- 
formations than was the difficulty of the passage. This was 
explained in terms of the redundancy of the language: 

That is, information which an individual may miss 
within the boundaries of a particular sentence may 
be acquired within some other sentences of the 
passage (42: 171) . 

The effect of linguistic variables upon readers of 

differing achievement levels was studied by Jefferson. 

Through the application of the cloze procedure he concluded 

that linguistic variables (lexical and structural) could be 

expected to predict readability equally well for poor and 
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good readers. He further concluded that the cloze procedure 
is capable of sampling lexical and structural categories. 
He cautioned that the nth word deletion confounds those two 
categories (53 : 177-78 ) . 

The degree of match between oral language structures 
of children and the syntactic structures in their textbooks 
has been studied; the degree of comprehension that occurs 
when oral and written syntactic structures are matched has 
also been studied. For example: oral language structures 
(independent clauses) produced by children were compared 
with the syntactic structures in elementary school reading 
textbooks by Strickland. She concluded that the speech of 
children was more sophisticated (85). Oral language struc- 
tures, ranging from high to low frequency , were written into 
reading passages for fourth-grade children in an investiga- 
tion by Ruddell. His purpose was to study the effect of the 
similarity of oral and written structure on reading compre- 
hension. He concluded that reading comprehension was a 
function of the degree of match of oral patterns of language 
to the patterns of language structure in reading material. 
He also concluded that reading material high in low-frequency 
patterns was harder to comprehend (77). 

Written language structures from a broad range of 
grade levels were studied by Smith. Students from grades 
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four through twelve read cloze paragraphs rewritten by their 
peers. Smith's purpose was to determine whether syntacti- 
cally more complex structures increase reading difficulty or 
whether all students, regardless of grade level, have the 
same syntactic skills and thus read with equal facility 
material written at different levels of syntactic maturity. 
Vocabulary and content were held constant. Smith concluded 
that students in grades four, five, and six found fourth- 
grade writing easier to read than writing by more mature 
students. For older students, fourth-grade writing was not 
the easiest to read. Eighth-grade writing was most easy for 
older students in graces eight through twelve to read. For 
both groups, habit may explain the differential performance 
(17:52-59). In a second study Smith challenged the assump- 
tion that short sentences are an appropriate measure for the 
readability of passages written for older readers. He 
pointed out that shorter sentences may be appropriate for 
younger children because they match their linguistic ex- 
pressions; but older students use more complex linguistic 
structures and therefore require more complex structures in 
reading materials (82:357). 

This review of the literature has thus far included 
a functional definition of readability, an overview of for- 
mulae from the earliest to the present state of the art, an 
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explanation of the cloze procedure and a suggestion of its 
implications for readability, and a review of the research 
by linguists into factors that impinge on the comprehensi- 
bility of the written word. This chapter will be complete 
when two additional topics have been covered. Those are: 
the? readability of subject area textbooks, and research 
studies and views most directly related to the design of this 
study. 

Readability: Subject Area Textbooks 

In 1949 Dale and Chall explained the limitations of 
readability formulae for measuring the readability of 
subject-area reading materials. Chall asserted that read- 
ability formulae are applicable only to material similar to 
the criteria on which they are based as: 

Too often this is forgotten and an attempt is made 
to apply a formula, based on children's reading, to 
materials that are beyond its range of subject mat- 
ter and difficulty. ... No studies are based 
exclusively on materials devoted to specialized 
areas such as science or mathematics (37:19-20). 

Nine years later Chall observed that readability formulae 
based on multiple correlations (number of syllables per sen- 
tence, sentence length, etc.) tend to lose their accuracy 
when applied to materials from subject matter areas differ- 
ing from those used in the original studies (6). 

There have been critics of the misapplication of 

O 
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formulae. Three instances will be cited here: the Dale- 
Chall (36) formula was applied in three separate studies by 
Brown (31), Kane (55) , and Proese (97). Brown concluded the 
formula was inappropriate for application to science mate- 
rials since much of the scientific vocabulary appeared out- 
side the formula's list of easy words (31:164). Kane con- 
cluded the formula was inappropriate for application to 
mathematical textbooks . He explained that the language of 
mathematical textbooks differs significantly from the lan- 
guage in literary works — the basis of the formula's word 
list (55:19). Froese concluded that cloze tests were more 
reliable measures of language difficulty than the formula 
readability levels in a study of science textbook materials 
(97). 

Numerous investigators have reported the lack of 
match in textbooks, that is, between the grade assigned by a 
publisher and the readability level assigned by formula. 
Smith studied the readability of mathematics textbooks for 
primary and intermediate grades. The Dale-Chall (36) and 
Spache (83) formulae were applied. He concluded that read- 
ability levels did not match the grade assigned by the pub- 
lisher and that textbooks were too difficult for most of the 
students (81:393) . 

Gallaway compared the readability of reading, 



language, science, and social studies textbooks for grades 
four, five, and six. The Dale-Chall (36) formula was 
applied. The reading textbooks equated with assigned grade. 
The remaining textbooks ranged from one to three grade 
levels above assigned grade (98). 

Cramer and Dorsey reported a mismatch between pub- 
lisher estimates and formula rating for elementary science 
textbooks. The Spache (83) formula was applied to six 
series of primary level textbooks, the Dale-Chall (36) to 
textbooks written for grades four, five, and six. Fourteen 
of the eighteen primary textbooks were correctly matched, 
but all of the eighteen textbooks for the middle grades were 
rated above grade level. The range was three to seven 
grades higher than the publisher's assigned grade (35:33). 

The Dale-Chall (36) formula was applied to word 
problems in arithmetic textbooks for grade six. The ratings 
were compared with the readability of word problems in three, 
standardized, arithmetic achievement tests. The textbook 
readability levels were at grade; although there was a four 
year spread in the range of samples taken. Test item read- 
ability levels ranged from grade four to grade six. The 
investigator was Smith (80:562). 

Ottley applied the Lorge (63) formula to science 
textbooks for grades four, five, and six. He concluded that 
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the textbooks for grade four were most difficult (poorest 
grade—readability match). The textbooks for grade six were 
the most well matched (best grade — readability match) (73: 
365-66) . 

Efforts to simplify textbook material were reported 
by Williams. One unit of a science textbook for grade six 
was rewritten to a third-grade readability level by applying 
the Yoakam (94) formula. Those readers using the rewritten 
unit were more successful as measured by comprehension 
scores and reading rates (92:206). 

The studies described thus far have been examples of 
formula readability — assigned-gradie mismatches in textbooks 
for the elementary grades. Numerous investigators have re- 
ported similar examples of mismatches in the secondary 
grades. A selected few have been summarized in the follow- 
ing paragraphs. 

The Dale-Chall (36) formula was applied in four 
separate studies by Belden (23), Wiegand (91), Lee and 
Hislop (59), and Smith (79). Belden concluded that only one 
of five biology textbooks was readable by a significant per- 
centage of high school students. Reading scores were the 
criterion used for comparison (23). Wiegand concluded that 
the predicted readability of mathematics textbooks was con- 
sistently higher than the reading abilities of students. 

ERLC 



Again, reading scores were the criterion used for comparison 
(91). Lee and Hislop compared the readability of special 
biology materials with two widely -used, general biology 
textbooks. They concluded all were of equal difficulty but 
above the reading level of students who must use them (59). 
Smith measured the readability of mathematics textbooks for 
grades seven and eight. Only six of the eleven textbooks 
for grade seven were matched with grade. Only five of the 
eleven textbooks for grade eight were matched with grade • 
Smith concluded the formula was inappropriate for applica- 
tion to mathematics textbooks (79) . 

The Flesch "Reading Ease" (44) formula was applied 
in three separate studies by Marshall (69), Janz and Smith 
(52), Simmons and Cox (78). Marshall rewrote passages in 
physics textbooks and compared comprehension scores of two 
groups of students. Both groups understood equally well. 
He concluded the formula may be inappropriate for estimating 
readability (69) . Janz and Smith concluded that textbooks 
in English, science, and social studies were unsuitable for 
students in grades eight, nine, and ten when one year was 
added to reading score means and means were compared with 
readability ratings of textbooks (52), Using a similar 
design, Simmons and Cox concluded that grammar textbooks for 
grades seven, eight, and nine were higher in readability 
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than the reading scores of sixty-five per cent of the stu- 
dent population (78). 

Negative student reactions were obtained after they 
read science and social studies textbooks. The "Fog" (10) 
formula was applied. It rated the textbooks six years 
higher than the reading scores of eleventh-grade students. 
The investigator was Symyrozum (86). 

The readability of United Nations publications was 
studied by Michaelis and Tyler. They applied three formulae 
and administered a reading test of content to high school 
seniors. They concluded that the three formulae yielded 
disparate results, and the publications were too difficult 
for the students to understand (70). 

Jacobson evaluated student understanding of passages 
from physics and chemistry textbooks. He concluded there 
was a significant difference in comprehensibility among 
textbooks, that the most readable textbooks were not most 
frequently used, and that textbooks lacked internal consist- 
ency (50) . 

The cloze test was applied to textbooks on American 
government, world history, biology, and chemistry; the dif- 
ficulty of prose was found to be about the same in all text- 
books. These conclusions contrasted sharply with the other 
studies cited here. The investigator was Beards* (22). 



Related Studies 



Vocabulary is a crucial factor in assessing read- 
ability. Twelve formulae in use are listed in Table 3 on 
page 22. The reader will notice that seven of the formulae 
have a variable identified as so-called, hard words, or, 
noun frequency count. In all seven formulae, frequency of 
occurrence of words (word difficulty) is a variable in the 
measure of reading difficulty. It was explained earlier in 
this chapter that the Talmudists counted words and indivi- 
dual ideas so they could know how many times each word 
appeared in the scroll, that is, how many times each word 
appeared in an unusual sense as compared with its usual 
meaning (64:544). It has also been explained that in 1840 
frequency of vocabulary was a factor in deciding ease of 
understanding in the McGuffev Readers (57:14). 

There are studies which have established the fact 
that quote: 11 frequency breeds familiarity." For example, in 
a study by Noble of the relationship between familiarity and 
frequency, he presented meaningless words visually. His 
subjects repeated them orally. He concluded that familiar- 
ity is determined almost uniquely by frequency (71:15). 

The values of word frequency are not surprising when 
one considers that a few words are used with high frequency, 
for example, in telephone conversations • In a study by 



H . R. French and others, as reported by Klare, 100 words were 
used 75 per cent of the time in a total of 80,000 words in 
500 conversations (57:13). In another study by Clyde E. 
Noble, as reported by Klare, the investigator concluded that 
in speech 100 of the most frequently occurring words make up 
49 per cent of the total (57:13). 

Parallels to the occurrence frequency of words used 
in conversational speech are found in studies of the occur- 
rence frequency of words used in reading materials. In a 
study by Carroll, and others, 1,000 words were used 74 per 
cent of the time in a total of 86,741 different words; 5,000 
words were used 89.4 per cent of the time. Samples were 
taken from 1,045 books for grades three to nine. Carroll, 
and others, explained the predicament of the English teacher 
faced with this situation: 

This admixture of large numbers of common words with 
large numbers of rare words presents a kind of para- 
dox that is the plague of the English teacher. Of 
course, it is true that many of the "rare 1 word 
types are compounds of — or are derived from — common > 
words, but even after these are laid aside, there 
still remain many rare words whose meanings must be 
learned if the student is to attain full comprehen- 
sion of verbal materials to which he is exposed 
(5 :xxviii) . 

In a study of the readability of twenty-five Newbery 
Award books a computer was used to determine the total num- 
ber of different words and their frequency. It was found 
that 200 words were used 61 per cent of the time from a total 
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of 5,443 different words. The investigators were Moe and 

Arnold (101:12). 

Klare observed an interrelatedness of word frequency , 

understanding, and a hierarchy in available meanings. His 

observations seem to be a fitting conclusion for this part 

of the discussion. He stated: 

The effects of frequency of occurrence of words upon 
superior comprehension in more . • . readable mate- 
rial takes several forms. First, increased fre- 
quency itself seems to play a role, as does the cor- 
responding increase in available meanings as fre- 
quency increases. The existence of a hierarchy 
among meaning frequencies apparently reduces the 
interference effects that might otherwise result 
when numbers of meanings are possible. Second, 
serial verbal learning appears to be improved, and 
perhaps free recall and other learning also. . . . 
Frequency of occurrence of words . . . clearly plays 
an all-pervasive role in language usage . . . humans 
. . . recognise more frequent words more rapidly 
than less frequent, prefer them, and understand and 
learn them more readily. It is not surprising, 
therefore, that this variable has such a central 
role in the measurement of readability (57:20). 

Brinton and Danielson identified underlying relation- 
ships in written language which suggested theoretical bases 
of readability. They identified two factors. The first 
included word frequency, length, and word familiarity and 
was called the vocabulary factor. The second included 
sentence length and syllables and was called the sentence 
factor (30:423). Stolurow and Newman obtained similar 



results in their study of the stylistic features of printed 
materials. They found that relative difficulty of words 



and relative sentence difficulty would account for a good 
deal of variance in readability (84:250). 

In 1949 it was Lorge's opinion that the best single 
element for the prediction of any aspect of expressional 
difficulty is vocabulary load. " Some researchers . . . have 
found that an estimate of vocabulary load , in and of itself , 
is a sufficiently sensitive index of readability." (65:91) 

The Botel (2) formula correlated at the .01 level of 
significance with four popular formulae in a study of the 
readability of selections for upper and secondary grades. 
The Botel formula utilized vocabulary as the only variable. 
The investigator in this study was Fry (45). 

In another vocabulary study Botel validated his 
readability formula and vocabulary tests. He measured the 
usefulness of the Botel Word Opposites Test (3) and the 
Botel Word Recognition Test (3) for assigning reading text- 
books to students; the level of expected student performance 
was set at 95 — 99 per cent fluency in oral reading and 75 — 
95 per cent comprehension in silent reading. He applied the 
Botel formula to the paragraphs of an informal reading inven- 
tory for reading textbooks published by the Scott , Foresman 
Company (15); he administered a total of four reading tests 
(including the two Botel tests) to a randomly selected 
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population of thirty, fourth-grade students. He concluded 
that the Botel word tests and the Botel formula provided the 
best match for the levels of expected performance (3:25,28). 

Reading skills specialists and classroom teachers of 
the Berkeley Unified School District, Berkeley, California, 
have established the validity of the Botel (2) formula — 
Botel (3) word-test match for determining placement of stu- 
dents in reading textbooks. This has been accomplished 
since 1970. Since that date specialists and teachers have 
established a practice of administering the Botel word tests 
and matching those results with Botel readability levels 
calculated for State-adopted reading textbooks. Teachers 
have then observed a student's comprehension level in the 
ass igned textbook. Performance expectancy for students has 
been set at the levels stated in the previous paragraph. 

Mata V. Bear, as reported by Klare, found that the 
percentage of monosyllabic words in a selection provided a 
fair index of reading difficulty (95:14). 

The formula of Yoakam applied the weighted index of 
words from Thorndike's (19) The Teacher's Word Book of 
30,000 Words . Vocabulary was the sole variable. The for- 
mula was last revised in 1948 (94). 

In 1973 Harris described a formula for primary grades 
which he had developed through the application of a computer. 
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Word samplings were taken from six reading-textbook series 
and from eight content-textbook series. A core list of 2,792 
words resulted. The per cent of words not on the core list 
was one of eight variables identified by Harris. He con- 
cluded that it correlated highest with the grade levels 
assigned by publishers to their books (.87). He suggested 
that the use of just this one variable would simplify the 
use of the formula. This formula awaits validation with 
student reading performance (99). 

Cloze scores were highly correlated with hard words 
on two popular word lists in a study reported by MacGinitie 
and Tretiak. They reported that the word list of 3,000 words 
from the Dale-Chall (36) formula and the word list of 769 
words from the Lorge (63) formula did well at predicting 
cloze scores of the Miller -Coleman Readability Scale (21). 
MacGinitie and Tretiak stated: 

The cloze criterion scores for the passages of this 
scale are based on restorations by college students. 
The summed bilateral cloze criterion scores for the 
Miller-Coleman passages correlate -.91 with the ratio 
of hard words based on the 3,000 word list and -.89 
with the ratio based on the 769-word list. These 
higher correlations and the fact that the number of 
one-syllable words and the number of letters per word 
correlate .88 and -.90- respectively, with the 
Miller-Coleman criterion scores (Coleman in press), 3 

3 E . B. Coleman, "Developing a Technology of Written 
Instruction: Some Determiners of the Complexity of Prose," 
in Verbal Learning Research and the Technology of Written 
Instruction , ed. by E. Z. Rothkopf and P. E. Johnson (New 
York: Teachers College Press, in press). 



emphasize the importance of vocabulary in the pre- 
diction of the difficulty of reading passages 
(67:375-76) . 

Summary 

Literature related to the topic of readability has 
been reviewed in this chapter . The reader learned that the 
topic goes beyond a discussion of such variables as legibil- 
ity, interest-value, and ease of understanding. An histor- 
ical perspective was drawn through a description of the 
evolution of readability formulae. Contrasting lines were 
drawn with a description of cloze procedure and linguistic 
structures. Restrictive lines were drawn in the review of 
research related to the readability of subject area text- 
books; there, lines were drawn by describing the inappro- 
priate use of some readability formulae in research. Some 
light was then cast on our perspective by singling out the 
continuing importance of vocabulary « In all of this, this 
writer was cautious not to attribute to vocabulary more 
value than it deserves in the whole, or totality, called 
readability. The five questions posed in the design of this 
study address themselves to some considerations which must 
become a part of that totality, if readability data sought 
in this study is to be applied productively in our efforts 
to match a reader with suitable reading materials. 

A description of the readability formula applied and 
the preliminary study will follow in the next chapter. 



CHAPTER III 



METHODS AND PROCEDURES 



Introduction 



In the f?.ll of 1969 the principals of the fourteen 
elementary schools in the City of Berkeley, California, 
decided they would disregard the four categories of learners 
described on pages 3 and 4 of this study. In discussions 
they concluded that classroom teachers should assign the 
adopted textbooks on the basis of the interests and the 
reading abilities of each student; these should be matched 
with the difficulty of textbooks. At that time this writer 
agreed that the reading abilities of the student should be 
matched with reading materials of appropriate difficulty. 
One obvious method for achieving a match was to apply a 
readability formula to determine levels of difficulty of the 
textbooks. This writer viewed this as an opportunity to 
challenge the implied assumptions, in the justification 
Statement (103), that one series was more suitable for a 
category of student than another — insofar as vocabulary was 
concerned. This writer decided to apply the Botel (2) for- 
mula to measure the difficulty of vocabulary in each text- 
book. This chapter describes the readability instrument and 
the preliminary analysis which followed this writers 
O 46 
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decision to match student reading ability with textbook 
difficulty. 

The Instrument 



The Botel (2) formula (hereafter referred to as the 
Formula) was selected for use in this study for a variety of 
reasons: (1) it was developed with words common to reading 
textbooks enjoying widespread use, (2) it was applicable to 
a wide range of reading levels commencing at grade one and 
extending beyond grade twelve, (3) any significant intra- 
text and inter -textbook differences in vocabulary usage 
would be readily apparent upon application of the Formula. 

The development of the Formula was described in a 
manual published in 1962. Botel explained the steps as 
follows : 

1. Assuming that basal readers are similar in diffi- 
culty, we made a study of the common words of five 
major basal reading programs at each level, from pre- 
primer through high third. We considered a word 
common at a given level if it appeared in three of 
the five readers. For example, since the word look 
appeared in at least three of the five pre-primers, 
we assigned look to a pre-primer level (2:8-9). 
[Botel referred the reader to pages 21-23 of the 
manual: the study to establish "Bucks County 1185 
Common Words 11 list. See Appendix X for example.] 

2. We then set out to establish a method which would 
compare the vocabulary of any book with typical basal 
readers. For example, if we should estimate the book 
to be beginning third level, this would mean that the 
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book was similar in vocabulary to the typical third 
grade basal reader. 

3. Next, we classified samples of 100 words from 45 
basal readers according to the level assigned by the 
'1185 Common Words 1 list. We used a form similar to 
the worksheet on page [See Appendix VII.] . . . Words 
not on the 1 1185 Common Words 1 list were assigned a 
4+ level. When we compared the distribution of voca- 
bulary from the same reading levels, as established 
by the publishers, we found this distribution to be 
remarkably similar. In each instance, a pattern 
appeared in the worksheets, or tables: Approxi- 
mately nine different words in each 100 word sample 
were found to be above the company-assigned reading 
level. 

Following this pattern, we counted down nine dif- 
ferent words and looked over to the left column for 
each 100 word sample. We were able to predict the 
reading level of 44 of the 45 basal readers within 
one-half grade level by using the designation in this 
column. In short, by the empirical observation of 
the pattern we found that the vocabulary distribu- 
tion of primary basal readers at a. given level is 
highly similar, ranging somewhere between eighty and 
ninety percent of the running words. 

In this technique, we assume that if a primary book 
has a vocabulary distribution pattern like that of a 
basal reader it has the same reading level. This 9 of 
course, is judging on vocabulary alone (2:9-10). 

Botel wanted to be able to apply his Formula to mate- 
rials written above third-grade level; he explained how that 
ability was assured: 

4. ... we tabulated 100-word samples of various read- 
ing materials: over 50 readers at the fourth, fifth, 
and sixth grade levels, many junior and senior high 
school textbooks, and many issues of Reader's Digest , 
Time magazine, and the New York Times . The results 
indicated that the total number of different words 

in the *4+ column* effectively indicated the reading 
difficulty. 

Thus we were able to establish a chart [see Appen- 
dix VIII] to use in estimating reading levels of 
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intermediate and secondary materials. [See Appen- 
dix IX for sample worksheet.] 

Greater variability, from page to page and from 
story to story, was found in materials for fourth 
grade and above than in primary materials. Some 
stories in a so-calle^ fourth grade book were as 
difficult as average sixth grade material, while 
senior high textbooks and the New York Times occa- 
sionally had materials such as found in typical 
sixth grade books. However, the sample of average 
difficulty was effective in discriminating among the 
levels (2:10-11) . 

Content validity of the Formula had been assured in 
Step 3 above, since 100-word samples taken from forty-five 
basal readers and the words on the "Bucks County 1185 Common 
Words" list (2:21-63) were remarkably similar in distribu- 
tion. This happened because words for both sources had been 
drawn earlier from the Thorndike (19) list by publishers of 
reading textbooks . 

Concurrent validity was affirmed in three studies 
reported earlier on pages 42 and 43 in Chapter II and 
repeated here. In the first study by Fry (45) the Formula 
correlated at the .01 level of significance with four cur- 
rently-used formulae in an investigation of the readability 
of selections for intermediate and secondary grades. The 
Formula correlated at the .05 level of significance with 
three comprehension tests in the saiue study. In another 
investigation the two Botel (3) word tests and the Formula 
provided the best match fcr estimating reading textbook 
placement for fourth-grade students; the criteria were 

9 
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fluency in oral reading and comprehension in silent reading 
(3:25,28). Since 1970, reading skills specialists and 
classroom teachers of the Berkeley Unified School District, 
Berkeley, California, have established the validity of the 
Formula — Botel (3) word-tests match for determining reading 
textbook placement for students in grades one through six. 
Teachers have followed up placement with observations of 
student comprehension of content in the assigned textbook. 
Comprehension standards have been set at 75 — 95 per cent for 
silent reading. Assignments have not been 100 per cent 
accurate, but the placement rate has been so satisfactory 
that the practice has been encouraged by this writer and by 
the reading skills specialists. 

The author of the Formula urged its use as a simple 
and easy-to-use method of determining a readability score 
for general story materials; he did not recommend its use 
for measuring subject-matter materials. He felt its value 
is enhanced when the teacher knows the achievement levels of 
students in reading textbooks or when reading levels have 
been determined by the Botel (3) word tests. He cautioned 
that readability scores obtained by the Formula are only 
indirectly useful in assigning a specific book to a specific 
child. "For no formula has yet been devised to take into 
account such variables as motivation, format, illustrations, 
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adult assistance, and so forth." (2:3) 

Preliminary Analysis 

In 1970 this writer applied the Formula to a minimum 
of seven, 100-word passages in all of the adopted textbooks 
except the Open Highways Readers (16). He also applied the 
Fry (45) and the Spache (83) formulae to a limited number of 
the textbooks for intermediate and primary grade textbooks, 
respectively. Time did not permit the application of the 
Fry and Spache formulae to all textbooks. It was felt by 
this writer, following the application of the two formulae, 
that the small amount of information gained was not worth 
the effort expended. The Formula readability levels have 
been reported in Table 4; these were given to the Berkeley 
reading skills specialists for use and distribution to other 
teachers. 

Summary 

The readability instrument, validity studies, and 
the preliminary analysis have been described in this chapter. 

Details of Formula application, and a statistical 
and descriptive analysis of the data will follow in the next 
chapter . 
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CHAPTER IV 



ANALYSIS OF THE DATA 

The Sampling Technique 

The data secured from the preliminary analysis were 
reworked. In that initial analysis as few as seven, 100-word 
samples and as many as seventeen, 100-word samples were taken 
from each textbook. In the present analysis nine, 100-word 
samples were taken from twenty-four textbooks. Two textbooks 
for the Harper and Row Basic Reading Program (14) were com- 
bined into one volume at the first, fourth, fifth, and sixth 
grade reader levels because the textbooks in the remaining 
three series had only one volume at each of those grade 
levels . 

The nine samples were located by dividing the total 
number of pages of text by nine. Some samples were retained 
from the preliminary analysis if they were reasonably close 
to the appropriate page number calculated for the present 
analysis. In some instances this was not possible so nine, 
new 100-word samples were taken. The Open Highways Readers 
(16) had not been sampled in the preliminary analysis and 
therefore were sampled in this study. 

The starting point on each page was determined by 
pointing to the text with eyes closed. The first word in 
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each sample was the first word in the sentence to which this 
writer pointed. Each 100-word sample was counted at least 
two times by this writer to ensure accuracy of count. Words 
were written cn worksheets and assigned a level. The accu- 
racy of that work was checked once by this writer. The pro- 
cedure has been described in the next section of this paper. 

Application of the Formula 

The Formula was applied to the reading textbooks 
in the following steps (and as demonstrated in Appendix 
XI). (1) Nine, 100-word samples were counted' in each 
textbook. Initials, first names, letters, and numbers 
were eliminated from the count. Hyphenated words were 
counted as one word. The word was placed at the level of 
the higher element. If only one part of a hyphenated word 
was on the list, the word was counted as 4+. Compound names 
of persons and places were counted as one word. (2) Each 
word in the 100-word sample was checked for level against 
the "Bucks County 1185 Common Words" list (2:21-63). Words 
not on the list were assigned the level of (3) Each 

word in the sample was written on a worksheet. If a word 
appeared more than once in a sample, tally marks were placed 
after it. Derived forms of higher levels were listed sepa- 
rately; a tally mark was made after the base word when 
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the derived form was of the same level. (4) After the 
100-word sample was placed on the worksheet, this writer 
counted down to the ninth word to determine the readability 
level. If there were nine or more words in the 4+ block a 
chart was used to determine the readability level (Appendix 
VIII). (5) After nine, 100-word samples had been placed on 
the worksheet, the sample of median difficulty was deter- 
mined. The readability level of that sample became the 
readability level for that book (2:25-26). 

Statistical Procedures 

Five questions were posed in Chapter I. The first 
of the five was subjected to statistical analysis and was 
stated in the form of the following null hypothesis: There 
will be no significant difference found in the readability 
levels of three collections of reading textbooks adopted by 
the State of California for four student groups (cultur- 
ally disadvantaged, slow, average, and fast). Readability 
levels are to be measured with the Botel (2) formula. The 
sign test was applied to the data to test the null 
hypothesis. This nonparametr ic test was applied to paired 
samples from the four textbook series. The paired samples 
constituted a two-category population (positive differences 
and negative differences) with the probability of any 
difference being positive — equal to the probability that 
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it would be negative. The null hypothesis was expressed in 
the following formula: H Q : P = Q = where H Q = the null 
hypothesis, P = the proportion of cases in one class in a 
two-category population, and Q = the proportion of cases in 
the other class of a two-category population (11:256-57). 

Analysis of Results 

To apply the sign test the nine, 100-word samples 
were paired for each textbook of the four textbook series. 
This required three paired groups (1-2, 2-3, 1-3). Each of 
the nine pairs was assigned a positive (+) sign of differ- 
ence, a negative (-) sign of difference, or a neutral (0) 
sign. The latter indicated a perfect match. Perfect 
matches were subtracted from N (number = 9) and de repre- 
sented the smaller of the observed frequencies (either + or 
-) in a series of nine pairs. Once the values of X and N 
were known, the two-tailed probability was calculated at the 
.05 level of significance and H Q was either accepted or 
rejected. See the example on the next page. In the example, 
nine paired samples in the textbook comparisons of Bank 
Street — Harper and Row and Harper and Row — Macmillan were 
significantly different at the 0.05 and 0.01 levels, respec- 
tively. The H Q was accepted for the Bank Street — Macmillan 
comparison. In Appendix XII the details of application of 
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**p < .05 .016** .004* 1.00+ 
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the sign test are given. 

Table 5, shown on page 58, is a summary of those 
instances where significant differences occurred in paired 
samples among the three groups of textbooks shown in Appendix 
XII. 

The results, reported in Table 5 on the next page, 
established that three of the five textbooks adopted for 
grades one, two, and three differed significantly; that is, 
three textbooks for the culturally disadvantaged group were 
easier than textbooks for the slow and average group but did 
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TABLE 5 



SUMMARY OF SIGNIFICANT DIFFERENCES IN READABILITY 
AMONG STATE -ADOPTED TEXTBOOKS FOR CULTURALLY 
DISADVANTAGED (CD) , SLOW (S ) , AVERAGE (A) , 



Publisher ' s 
Grade 

Assiqnment 


d-2) 
(CD)-(S&A) 


(2-3) 
(S&A)-(F) 


d-3) 
(CD) -(F) 


1 (l 2 ) 


2 1_ 2 2** 


2 2_ X 2* 


- 


2 (2 1 ) 
(2-*) 


2 2_ 3 1* 


3 1_ 2 1** 


- 


3 (3 1 ) 
(32) 


2 2_ 3 1** 





_ 




(CD&S)-(A) 


(A) 


(CD&S ) — (F) 


4 








5 






4-6** 


6 








*0.01 (two- 
**0.05 (two- 


tailed test) 
tailed test) 







not differ significantly when compared with textbooks for 
the fast group. Two of the five textbooks adopted for grades 
one, two, and three differed significantly in a second com- 
parison; that is, two textbooks for the fast group were 
significantly less difficult than textbooks for the slow and 
average group. Textbooks adopted for grade five differed 
significantly in one comparison; that is, the textbook for 
the culturally disadvantaged group was significantly easier 
than the textbook for the fast group. The H Q was accepted 
for the remaining comparisons. No other significant differ- 
ences were obtained. 



TABLE 6 

READABILITY LEVELS OF STATE -ADOPTED READING TEXTBOOKS 



Publisher ' s 


Bank Street 


Harper & Row 


Macmillan 


Grade 

Assignment 


(CD) 


(S&A) 


(F) 


1 


d 2 ) 


2 1 


2 2 


x 2* 


2 


(2 1 ) 
(2 2 ) 


2 2 
2 1 


3l 
3l 


2 1* 
2 2* 


3 


1 

(3 1 ) 
(3 2 ) 


2 2 
9 2 

Scott, Frsmn. 


3 1* 


32 
,2* 






(CD&S) 


(A) 




4 


(4) 


32 


5 


4 


5 


(5) 


4 


7 


6 


6 


(6) 


6* 


7 


8 


♦Readability level matches publisher's 
assignment. N = 7 (29 per cent). 


grade 






Descriptive 


Procedures 





The second question posed was: Is there a gradual 
increase in the readability levels within each of the three 
collections of textbooks, starting with textbooks for grade 
one and continuing through textbooks for grade six? The 
conclusion was a qualified, no. Table 6, shown on this page, 
was constructed to assist in the answering of that question; 
the readability levels of the textbooks have been shown in 
it. A visual inspection of the data revealed there was not, 
in all cases, a gradual increase in the readability levels 
within each of the three collections of textbooks for the 
four student groups, starting with textbooks for grade one 
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and continuing through textbooks for grade six. Only seven 
(29 per cent) of the twenty-four textbooks were matched with 
respect to readability level and the publisher's grade 
assignment. There was a noticeable absence of a gradual 
increase in readability levels between textbooks within the 
Bank Street and Harper and Row series for grades two and 
three. The Macmillan textbooks achieved the most gradual 
increase in readability levels between textbooks and thus , 
the best match of readability level with publisher's grade 
assignment. 

The third question posed was: When nine, 100-word 
samples are drawn from each textbook, will the readability 
level of the samples increase gradually, starting with the 
first sample and ending with the ninth sample? The con- 
clusion was, no. A visual inspection of the data in Table 
7 on the next page led to the following conclusions: (1) as 
observed earlier, in only seven (29 per cent) of the text- 
books did the readability level of the first sample match 
the publisher's assigned grade; (2) in ten (42 per cent) of 
the textbooks a minimum of one sample (between the second 
and eighth) was below the readability level of the first 
sample; (3) in four (17 per cent) of the textbooks the read- 
ability levels of the first sample and the ninth sample were 
identical ; (4) in six (25 per cent) of the textbooks the 
readability level of the ninth sample was lower than the 
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first sample; (5) conversely, in fourteen (58 per cent) of 
the textbooks the readability level of the ninth sample was 
higher than that of the first sample. 

The fourth question posed was: Does the range of 
readability levels of samples drawn from textbooks vary 
from book-to-book within each of the three collections of 
textbooks, starting with the textbook for grade one and con- 
tinuing through the textbook for grade six? The conclusion 
was a qualified, yes. Tables 8 and 9, on pages 63 \nd 64, 
were constructed to determine any differences in range. The 
readability levels of nine, 100-word samples, drawn from 
each of the twenty-four textbooks, have been shown in Table 
8. Each of the nine samples has been listed in rank order 
from the lowest readability level (rank 1) to the highest 
readability level (rank 9) . Samples were rank ordered so 
that interquartile ranges could be calculated for each text- 
book. The interquartile range is the distance between Q3 
and Qi or 50 per cent of the distribution. In nine samples 
the value of equals 2 (second sample) and the value of 
Q3 equals 8 (eighth sample). Thus, the task was to subtract 
the value of sample 2 from the vulue of sample 8 to deter- 
mine the interquartile range (8:32). To accomplish this it 
was first necessary to assign values of an interval scale to 
the readability levels of the Formula. That was done in 
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TABLE 9 

INTERVAL-SCALE VALUES ASSIGNED TO FORMULA 
RLADABILITY LEVELS 



r orntuia Lie vex 


Scale 


vaxue 


1^ 


1. 


.5 


2 1 


2. 


.0 


2^ 


2. 


.5 


3 X 


3. 


.0 


3 Z 


3. 


.5 


4 


4. 


.0 


5 


5 


.0 


6 


6 


.0 


7 


7 


.0 


8 


8 


.0 


9 


9 


.0 



Table 9 above. 

Thus, the interquartile range was calculated for 
each textbook by applying the formula Q3 - Q±; that is, 
sample 8 minus sample 2. For example in Table 8, Bank 
Street (l 2 ) : Q 3 = 2 1 , Qi = l 2 7 therefore, 2 1 -l 2 = 2.0 -1.5 
= .5. Thus the interquartile range was .5 for that textbook. 
Interquartile ranges were calculated for the twenty-four 
textbooks and have been summarized in Table 10 on the next 
page. 

A visual examination of the data in Table 10 revealed 
a sharp rise in the size of the interquartile range in all 



65 



B 

I 



w 



&4 H 

S < 

Eh Eh 

pq Eh 

55 h 



§ 

o 
o 



&4 O 
O B 
H 

w 

CD 
5 



3 



P 

w w 

A Eh 
H CU 
^ O 

a w 

Eh 

pa < 

125 Cfl 



co ro 

H I 

O H 

a w 



rH I 
O CN 



4 

M 
(D 

M 



^ CN 



CO CN 
rH I 
O rH 







0) 


















Q H 





















•H <D (J) 

H 'd -H 

,Q CO 

3 M CO 

04 a < 



+ + 



I o 



in 



in in 



o in 

H CN 



+ + 



in o in in o 
rH H ro 



O I 



in 



o o 

rH rH 



in m 

CN 



IS) 
* 

CN 



e 

CO 
JH 



o 

u 

05 



CO 



w 












•P 










c 












CN 


rH CN 


rH CN 




e 


rH 


CN CN 


ro ro 


CO 


C5 









o 

CN 



in 
« 

m 



— in o 
w ro <tf 



o 



o 

t 

CN 



m 
m 



CN 



ro 



<tf m 



m \D 



+ 

. o 

CN|<t O 



+ 

i * 

cN|r^ in 



£ 

ro 



fltl sss 



T3 
<U 
-P 
Cu 
<U 

a 
u 

0 

n 



ERLC 



three textbook collections. This occurred in the third 
reader, second part (3 2 ). It was clear that the interquar- 
range varied from book -to-book within each of the three col- 
lections of textbooks . 

The fifth question posed was: Is there a difference 
in the range of readability levels of samples drawn from the 
three collections of textbooks, starting with a comparison 
of all textbooks for grade one and continuing through all 
textbooks for grade six? The conclusion was a qualified, 
yes. In this fifth comparison interquartile ranges were 
compared at each grade level across the three collections 
shown in Table 10 on the previous page. The ranges were 
identical for first-grade textbooks, but this was not true 
at any other point in the Table. However, two of the three 
interquartile ranges were identical in textbooks for grade 
two (2 1 ), grade three (3^ and 3^), grade five (5), and grade 
six (6). The sign test was applied to determine if there 
were significant differences in the interquartile ranges of 
the three textbook collections (11:256-57). No significant 
differences were found; H Q was accepted. 

Summary 

This chapter has included a description of sampling 
procedures, formula application, statistical methods used, 



and a statistical and descriptive analysis of obtained read- 
ability data. 

The next chapter will include a summary of findings 
and recommendations. 



CHAPTER V 



SUMMARY OF FINDINGS, RECOMMENDATIONS, 
AND EDUCATIONAL IMPLICATIONS 

The Purpose Restated 

The purpose of this study was to determine if there 
was a significant difference in the readability of reading 
textbooks adopted by the State of California for four 
student groups in grades one through six: the culturally 
disadvantaged, the slow, the average, and the fast. A fur- 
ther purpose was to suggest, on the basis of readability 
data, procedures teachers may follow when assigning reading 
textbooks to students. 

Findings 

Five questions were posed to answer the purpose of 
this study. The first question was stated in the form of a 
null hypothesis: There will be no significant difference 
found in the readability of three collections of reading 
textbooks adopted by the State of California for four student 
groups (culturally disadvantaged, slow, average, and fast). 
Significant differences were obtained when comparing text- 
books for the culturally disadvantaged — slow and average, 
student groups; differences were present in three of the 

68 
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five comparisons for grades one, two, and three. Signifi- 
cant differences were also obtained when comparing textbooks 
for the slow and average — fast, student groups; differences 
were present in two of the five comparisons for grades one, 
two, and three. One significant difference was obtained 
when comparing textbooks for the culturally disadvantaged — 
fast, student groups for grade five (Table 5, page 58) . 

The second question was posed to determine if there 
was a gradual increase in the readability levels within each 
of the three collections of textbooks. A visual inspection 
of readability data in Table 6 on page 5 9 revealed that the 
Macmillan textbooks achieved the most gradual increase in 
readability level from textbook-to-textbook. 

The third question was posed to determine if there 
was a gradual increase in readability from the first to the 
ninth sample within each textbook. There was not. Read- 
ability levels fluctuated between the two samples (Table 7, 
page 61) . 

The fourth question was posed to determine if the 
range of readability levels within each of the textbooks was 
the same for the twenty-four volumes. It was not. There 
was an appreciable increase in range for all textbooks com- 
mencing with third reader, part two (3^) through sixth 
reader (6) (Table 10, page 65). 



The fifth question was posed to determine if there 
was a difference in readability range among the three col- 
lections of textbooks at each grade level. A visual inspec- 
tion of data in Table 10 on page 65 revealed the ranges were 
identical only for first-grade textbooks across the three 
collections. There were no significant differences in the 
interquartile ranges when comparisons were made among the 
three collections . 

Earlier, in Chapter I, this writer made inferences 
about the difficulty of vocabulary in the adopted textbooks. 
Those inferences were described in Chapter I under the head- 
ing "Need for this Study." They were made by this writer 
after he had read the vocabulary portion of the justifica- 
tion Statement (103:17,21,24,26). For the data described 
in this, and the following two paragraphs, please refer to 
Table 5 on page 58. In the instance of vocabulary used in 
the Bank Street and Open Highways readers, it had been anti- 
cipated that the vocabulary would deviate measurably from 
the Harper and Row and Macmillan readers — especially since 
the justification Statement explained that the text in the 
first two reader series was descriptive of real-life exper- 
iences and utilized the syntax of spoken language (103:24, 
26). The resulting lower readability ratings for the Bank 
Street readers suggested that the textbooks were 



significantly easier in three of the five comparisons with 
the Harper and Row readers . Only one of the Open Highways 
readers was noted to differ significantly from the remain- 
ing two collections. In that comparison the fifth-grade 
textbook was easier than the Macmillan reader adopted for 
the fast student group. 

In the instance of the vocabulary used in the Harper 
and Row readers, it had been anticipated that an expanded 
vocabulary for grades one through three and an elimination 
of vocabulary controls at grade five would yield textbooks 
more difficult than the grade assigned them by the publisher 
This was true in six of the eight volumes (Table 6, page 59) 
It had also been anticipated that the Harper and Row readers 
would be more difficult than the Bank Street and Open High- 
ways readers. This was true in the case of the Bank Street 
readers as described in the previous paragraph; but the same 
difference did not occur in the comparisons with the Open 
Highways readers. Further, it had not been anticipated that 
the Harper and Row readers for grades one and two would have 
significantly higher readability ratings than the Macmillan 
readers adopted for the fast student group. 

In the instance of the vocabulary used in the 
Macmillan readers, it had been anticipated that the readers 
would be significantly more difficult than the vocabulary in 



the other two collections because vocabulary controls had, 
alledgedly, been eliminated for all textbooks in that 
series. That was not the case. Instead, only one textbook 
out of eight had a readability level significantly higher 
than the others. 

This writer had anticipated that the readability of 
the twenty-four textbooks in the collections would be higher 
than the grade levels assigned by publishers. This was true 
in only eleven of twenty-four comparisons (Table 6, page 59) 

Recommendations for Further Research 

Vocabulary was the sole variable analyzed in this 
study. Future research should include an analysis of syn- 
tax, style, and semantic variability; reader and teacher 
backgrounds, interests, and degree of motivation should also 
be studied. 

Educational Implications 

Earlier in Chapter II readability was defined by 
Gilliland in terms of matching — matching materials differing 
widely in content, style, and complexity with readers who 
can comprehend them (9:12). Using a similar theme, Botel 
described readability in terms of matching pupils with books 
He cited seven variables and called them crucial in the 



matching process. The variables were: vocabulary, syn- 
tactic difficulty, style, semantic variability, reader 

V 

interest, reader background, and level of motivation (106). 
On the same occasion, Ruddell described readability as the 
fit between the reader's linguistic, cognitive, and affective 
background and the reading materials (106). 

The educational implications of this study are obvi- 
ous and can be stated simply: The readability of textbooks 
is one important variable which can assist teachers in 
achieving a match or fit of materials to readers when it is 
weighed with other variables like those just enumerated. 

The task of achieving a match has been a continuing 
process for the reading skills specialists and classroom 
teachers of the Berkeley Unified School District, Berkeley, 
California, since 1970. Since that date specialists and 
teachers have established a practice of administering word 
tests prepared by teachers or published tests like the Botel 
(3)* Teachers have then compared those results with the 
Formula readability levels calculated for the adopted read- 
ing textbooks. Word-test results and Formula levels have 
been matched; then textbooks have been selected and assigned 
on the basis of teacher judgement regarding interest poten- 
tial of content when weighed against the background and 
level of motivation of students. Once assigned, teachers 
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have then observed how well students comprehend textbook 
content. Performance standards were set at 95 — 99 per cent 
fluency in oral reading and 75 — 95 per cent comprehension in 
silent reading. 

The procedures outlined above have been described in 
greater detail in Appendix XIII , on page 103 , under the 
title: Matching Students and Books: A Handbook for Teachers . 

Sumiuary 

This chapter has included a restatement of the pur- 
pose of this study, a restatement of the five questions 
posed with summarized findings, and recommendations for 
further research — extending to teacher background, interests, 
and motivation. 
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184 Park Street 

San Francisco, California 

94110 

September 12, 1973 



Harper & Row Publishers 
School Books Department 
2500 Crawford Avenue 
Evanston, Illinois 60201 

Gentlemen: 

I am a teacher in the California public schools and 
am writing a dissertation. My topic is an analysis of the 
readability of reading textbooks adopted by the State in 
1968. 

Did your company apply a readability formula to 
the Harper & Row Basic Readers? If so, which one? Can 
you supply me with the data? 

If no readability formula was applied, on what bases 
were grade levels assigned to reading texts for grades one 
through grade six? 

I shall appreciate your reply. 

Sincerely yours, 



R. W. Saunders Jr 
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184 Park Street 

San Francisco, California 

94110 

September 12 , 1973 



Macmillan Publishing Company 
Editorial Department for School Books 
866 Third Avenue 
New York, N. Y. 10022 

Gentlemen: 

I am a teacher in the California public schools and 
am writing a dissertation. My topic is an analysis of the 
readability of reading textbooks adopted by the State in 
1968. 

Did your company apply a readability formula to the 
Macmillan and Bank Street Readers? If so, which one? Can 
you supply me with the data? 

If no readability formula was applied, on what bases 
were grade levels assigned to reading texts for grades one 
through grade six? 

I shall appreciate your reply. 

Sincerely yours, 



R. W. Saunders Jr. 
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184 Park Street 

San Francisco, California 

94110 

September 12 , 1373 



Editorial Department/Open Highways Program 
Scott, Foresman and Company 
1900 Lake Avenue 
Glenview, Illinois 60025 

Gentlemen: 

I am a teacher in the California public schools and 
am writing a dissertation. My topic is an analysis of the 
readability of reading textbooks adopted by the State in 
1968. 

Did your company apply a readability formula to the 
Open Highways Readers? If so, which one? Can you supply me 
with the data? 

If no readability formula was applied, on what bases 
were grade levels assigned to reading texts for grades four 
through grade six? 

I shall appreciate your reply. 

Sincerely yours, 



R. W. Saunders Jr 
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Harper 6) Row, Publishers, Inc. 



New York Evamtoa London 



m 

1817 



School Department 



2500 Crawford Avenue 
Evamton. Illinois 60201 
Phone: 322-866-8600 

October 9, 1973 



Mr* R. V. Saunders, Jr. 
184 Park Street 

San Francisco, California 94110 
Dear Mr. Saunders: 

Your letter of September 12 concerning the readability of 
The Harper & Row Basic Reading Program has come to my 
attention. 

As you no doubt know, there are a variety of readability for- 
mulas; these are usually applied to non-text materials in 
order to discover their probable grade-level suitability. It 
is our professional position that such readability figures have 
serious limitations which make them unreliable for non-text 
materials and completely useless for banal reading texts. 

A basal reading program by definition teaches reading. At the 
primary levels of The Harper & Row Basic Reading Program, for 
example, every word the pupil reads is carefully taught before 
he sees it in the text; each word is used in the pupil's ma- 
terials many times thereafter. If one of these words is not 
included on the vocabulary list for a certain readability 
formula, it must be considered "unfamiliar 11 and it therefore 
increases the difficulty level according to the formula. 
However, our carefully planned teaching leads us to be certain 
that such words as are used in our basal readers are completely 
familiar. 

Therefore, the basis on which our texts have been assigned to 
grades is their instructional level. We have taken into 
consideration such factors as interest, story excitement, 
familiarity of situations, clarity of concepts, and simplicity 
of syntax, as well as familiarity of vocabulary. 

I hope this is of some help to you. 



Sincerely, 



BH:s 



Editor, Reading Department 
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MACMILLAN PUBLISHING CO., INC. 
666 Third Avenue, New York, N. Y. 10022 



tCHOOL DIVISION 



October 3, 1973 

Mr. R. W. Saunders, Jr. 

184 Park Street 

San Francisco, Calif. 94110 

Dear Mr. Saunders: 

In response to your Inquiry of September 12, concerning the formula 
for readability used by Macnillan, let roe direct you to the work 
done by Dr. Albert J. Karris on reading and vocabulary lists. 
In addition to this information you will want to know that 
Macrolllan utilizes the readability levels devised by Chall 
for roost primary texts and that devised by Spache . for certain 
of the Intermediate reading levels. 

You have our good wishes for continuing success In your studies. 

Sincerely, 

Ms. K. O'Rourke 
Marketing Manager 



KO'R/ss 

cc: C. Boultlnghouse 
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U SEARCH AND INFORMATION 



OPEN HIGHWAYS : Criteria for Judging Sliding Difficulty 



Every .selection included, or considered for inclusion, in the OPEN HIGH- 
WAYS books was measured by a standard readability formula— the Spache 
(primary) or the Dale-Chall. Each selection chosen was placed in the 
book and the section of the book for which it was adjudged suitable as 
to reading difficulty, according to the formula. 

The Dale-Eichholz list was used in adapting material, and wherever pos- 
sible words from this list that are familiar to 67 per cent or mora of 
fourth- graders, for example, were substituted for words judged "difficult" 
by formula. 

However, the consideration of readability for a given level did not end 
with the application of the formula. Such factors as the following were 
also token into account: 

level of Interest 

background needed for full Interpretation 

maturity of concepts 

literary form 

author* s style 

paragraph length 

new vocabulary 

Many linguists believe that the removal of connectives, such as and , 
but , and because, In order to shorten sentences, actually increases dif- 
ficulty* The connectives clue the child to cause-affect, sequence, and 
analogous relationships. This, too, was carefully considered in the 
evaluation of sentence length. 

In some cases, a selection that checked out et the expected readability 
level, according to the formula, was actually placed in e later book 
(or later in a book) because of the verious fee tors considered. For 
example, Burma Boy , which appears in OPEN HIGHWAYS, Book 6, is of low 
reading difficulty, according to the formula, but the concepts and foreign 
settings led us to place it where It Is. 

To the best of our knowledge and belief, selections in OPEN HIGHWAYS are 
at the level indicated for each book and section. 
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Primary Readability Worksheet 



Book: Frogs and Toads 
Publisher. Follett Publishing Company 
Botel Readability Score: 3-2 




Word 
Level 


SAMPLE 1 

pp. 8-9 Level: 3-1 


SAMPLE 2 
pp. 18-19 Level: 3-2 


SAMPLE 3 

p. 28 Level: 3-2 


4th 
Reader 

<St above 
4+ 


swamp 
throat 
size 
match 

4 


crops 

mosquitoes 
common 
leopard 11 
swamps 

creeks ^ 


toads 11111 

hawks 

crows 

snakes 

mosquitoes 

10 


High 3rd 
Reader 

3-2 


wake 

1 


insects 
twelve 
inches 1 
less 

5 


search 
insects 1 
during 
enemies 

inch £ 


Beg. 3rd 
Reader 
3-1 


frocs 11111 1 

a a ^ay>* ^ A A A A a 

lake 
begins 1 
puffs 

11 


frog 11111 11 

helpful 

because 

rings 

lakes 

12 


grown 

rock 

earth 

3 


High 2nd 
Reader 

o 0 


winter 
leaves 
holes 
pond 
sing 11 
hear 
sure 
lay 1 

11 


hurt 

nun 

legs 

food 

most 1 

parts 

only 

spots 1 

ponds 

world 

11 


leave 

hop 

most 

catch 

fall 

yean 

winter 

hole 

ground 

warms io 


Beg* 2nd 
Reader 
2-1 


spring 1 
their 1 
or 

balloon 
sign 

7 


which or 

found 1 near 

country 

grow 

an 

8 


grow 

an 

or 

until 
spring 

5 


1st 
Reader 
& 

Below 


11111 Hill 11111 
11111 11111 11111 

inn inn inn 
inn inn inn 

11111 1 66 


11111 11111 11111 
11111 11111 11111 

inn uni inn 
inn mil i 

56 


inn inn inn 
inn urn inn 
inn inn inn 
inn urn inn 
inn i ae 


Total 
Word 
Sample 


100 


100 


100 



APPENDIX VIII 



Estimating Reading Levels of Intermediate 
and Secondary Materials 



kiss nf htll«Mn* \AI*\mHm 

Pi o« Of Uvrreroni worot 
Beyond 3-2 Level 


Reeding Level 


9-10 


4th 


11-12 


5th 


13-15 


6th 


16-18 


7th 


19-22' 


8th 


23-28' 


0th 


27-30 


10th 


31-33 


11th 


34 + 


12th 



1 Average difficulty means that If three 100- ^ord samples are taken to evaluate the reading 
level of a book, the sample of median difficulty would be used to determine reading level 
by this table. For example, if in three samples you got 18, 15, 16 words appearing beyond 
3-2 levjl, you would use 16 to predict the rending level of the book. 

1 Reader's Digest samples averaged 21 different words in the 4+ column. 

* Time magazine samples averaged 23 different words in the 4+ column, N*w York Timet 
samples averaged 28 different words in the 4+ coruran. 



APPENDIX IX 



Intermediate and Secondary Worksheet 



Book: George Washington, Leader of the People 
Publisher: Follett Publishing Company 
Botel Readability Score: 7th 



Word 


SAMPLE 1 


SAMPLE 2 


SAMPLE 3 


Level 


p. 33 Level: 6th 


p. 131 Levef: 7th 


p. 175 Level: 7th 




admiral 


crop 


Popes 




allowed 


manure 


Creek 




Creek 11 


mixtures 


stirred 




shocked 


enrich 


merely 




grinned 


soil 


tossing 




understandingly 


tinkled 


strolled 




nnliriaVc 


fflriniuwl 

gnnncu 


general 




modest 


UUMllVM 




4th Reader 


Pope's 


evening 


yeDed 


d* above 


business 


creek 


approval 


4+ 


raising 


flooded 


cheered 




colony 


slave 


Washington 




erect 


mansion 


rounders 






Washington 1 


square 






dam 


bases 






rail) 


batter 




TOTAL WOPDS: 15 


total words: 17 


TOTAL WORDS: 16 




DIFFERENT WORDS I 13 


DIFFERENT WORDS: 16 


DIFFERENT WORDS: 16 


High 3rd 








Reader 








& Below 










85 


83 


84 


Total 








Word 








Sample 










100 


100 


100 
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Graded Vocabulary List 



alone 2-2 
along 2-1 
•aloud 3-1 
already 3-2 
also 3-1 
always 2-2 
ant p 

among 3-2 

amount (s, ed, ing) 3-2 

an 2-1 

and pp 

angry 2-2 

animal (s) 1 

another 2-1 

answer (s, ed, ing) 2-2 

any 2-2 
•anybody 3-2 
•anyhow 3-2 
•anyone 3-2 
•anything 3-2 
•anyway 3-2 
•anywhere 3-2 

apple (s) I 

apron (s) 2-2 
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WORKSHEET FOR DETERMINING READABILITY OF 100-WORD SAMPLES 



Book: ^tb-g^Jb**^^ Readability: 4 


Word 
Level 


SAMPLE "1 
Ph/</ Level t 


SAMPLE 2 
p.//** Level 7 


SAMPLE 3 
p. '7/ Level 6 


4+ 




(3) 




3^ 


®> 


J 

<£> 




3 1 


> m * ^ — J i 


(g) 


® 


2 2 








© 












*rt*+\jL/ II ' ' 


Below 
2l 


7m.m mrmm 
mnuittkiHiWki ® 

7" 75o~ 


mm m mm — . 


mrta-mum-m. 
mm wiiHiflR ^— >. 

/CO 



WORKSHEET FOR DETERMINING READABILITY OF 100-WORD SAMPLES 



Book: ^M^^^fu^a/ Pub. : *??Ju>w%iU**J Readability: 


Word 
Level 


SAMPLE 4 
p. ?>3i Level 7 


SAMPLE 5 
p. Level 6 


SAMPLE 6 
p.JV 4 / Level 


4+ 


^auuJUl^ III 
C&y*%^ /titer 


^ 6 ^ J. ~ A*Jr 


«./■/«« 


6 


© 






3 




&u*0*aAS HI 




2 2 


B 


- - — r * m -* *r ^ * J t 

yC+AS 1 

® 




2 1 








Below 
2* 


wjl/w rww//i 


too 


mrtH.'mTtHTHi. 
DH.7HUII 

/ SO 
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WORKSHEET FOR DETERMINING READABILITY OF 100-WORD SAMPLES 



Book : ^nJU,/$***4*t&<s4S Pub . : ^l*<swc^4**o Readability: 


Word 
Level 


SAMPLE 7 
p.^f? Level v5" 


SAMPLE 8 
p.</5& Level \3 A 


SAMPLE 9 
p.v^of Level 7 


4+ 




.« it/' mit ifrt t»i 




n 


/m. it X 


32 


© 


<c*-U> 1 


© 


3 1 


© 


> ® 


w 


22 






eft go - -XAa^e^- 


2 1 








Below 
2 1 


•7- /oo 


THITHi 7H II 

/oo 





9 
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— OVERVIEW OP CONTENT — 



Readability levels ; Using vocabulary as the variable, the 
Botel readability formula* was applied to State-adopted 
reading textbooks . 

Teacher-prepared tests ; Word-recognition tests were prepared 
at each reader level by sampling every nth word to con- 
struct a li^t of twenty vocabulary words. 

Word-opposites tests were prepared at each reader level by 
sampling words from each reader and constructing ten test 
items at each level. 

Suggestions for student placement ; Procedures for placement 
will be described. These have been validated by staff in 
the Berkeley Schools. 



— TABLE OF CONTENTS — 

Pages 



Readability Chart: State Textbooks 1 

Recommendations for Student Placement 2 

WORD-OPPOSITES TESTS 

HARPER: Answer Key & Scoring Standards .... 3-8 

HARPER: Student Test Sheets 9-13 

MACMILLAN: Answer Key & Scoring Standards . . 14-18 

MACMILLAN: Student Test Sheets 19-22 

WORD-RECOGNITION TESTS : 

Test Cards and Scoring Standards 23-33 

BANK STREET: Scoring Sheet 34-36 

HARPER: Scoring Sheet 37-39 

MACMILLAN: Scoring Sheet 40-42 

OPEN HIGHWAYS: Scoring Sheet 43 



*Morton Botel. Predicting Reading Levels . Chicago: 
Follett Publishing Company, 1962. 
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— RECOMMENDATIONS FOR STUDENT PLACEMENT — 

Three categories of recommendations are explained 
below: (1) Minimum service to students, (2) Additional 
service, (3) Other alternatives . 



Minimum Service 

1. CHOOSE an appropriate reader series. Administer and 

score the word-recognition test for that series. 

2. MATCH instruction level with the textbook having the 

same readability. 

3. ASSIGN textbook and observe student's progress. Apply 

standards: 95 — 99 per cent oral reading accuracy, 
75 — 95 per cent comprehension of silent reading. 



Additional Service 

1. FOLLOW Step 1 above. 

2. ADMINISTER word-opposites test. Combine results of both 

tests . 

3. MATCH instructional levels with textbook having the same 

readability. 

4. ADMINISTER criterion-reference test which accompanies 

the textbook series. Evaluate results. 

5. FOLLOW Step 3 under "Minimum Service." 



Other Alternatives 

1. CONSTRUCT word tests for other basal reader series. Use 

the same selection procedures for words, or administer 
the Botel inventory.* 

2. APPLY the Botel readability formula or another formula 

to textbooks . 

3. FOLLCW Steps 3, 4, and 5 under "Additional Service." 
*Morton Botel. Botel Reading Inventory , Follett Pub., Co., 

1962. 
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BERKELEY UNIFIED SCHOOL DISTRICT 
CURRICULUM CENTER 

Harper 

Word Opposites (Group) Test 
(Grades 3-6) 

Prepared by: Russell Saunders, Consulting Teacher 

ANSWER KEY AND SCORING STANDARDS 



Level Text 

A (1) JANET AND MARK; OUTDOORS & IN; 

CITY DAYS, CITY WAYS; JUST FOR FUN; 
AROUND THE CORNER; REAL AND MAKE 
BELIEVE 

B (1-3) FROM ELEPHANTS TO ESKIMOS 

C (2-1) ALL THROUGH THE YEAR 

D (2-2) FROM FINS TO FEATHERS 

E ( 3-1) FROM FAR AWAY PLACES 

F (3-2) FROM BICYCLES TO BOOMERANGS 

C (4) TRADE WINDS 

I! (5) CROSSROADS 

1 (t> > SEVEN SEAS 



Scoring Standards 



READING LEVELS 



F ree Reading Leve ls 

(Easy: Pupil can read 
with profit: without 
any teacher help.) 

Instructional Levels 

(Suitable: Pupil usually 
needs teacher guidance for 
comprehension and inter- 
pretation) . 

Frustration Lev els 

(Too difficult Pupil 
cannot read with profit 
even with teacher help.) 



No. of words 
correct out 
of 10 



K) 



% of 
accuracy 

100, : 



80% 
70% 



65% - 0 



60% - 0 



NOTE 

The readability of the stimulus word and the response word is stated in 
brackets in the answer key. Example: Look at level A, item 1 
I. Up (pp) little down (pp) you 

^-Stimulus Word level Response Word level 

The remaining words in each question are of the leveL of the stimulus 
Ja£QX£. The x Botel formula was used to determine readability of all 
the words iru this test. 



Botel, Morton Botel Predicting Readability Levels > Follett Publishing 
Co., Chicago, 1962. 
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Harper 



Harper 



WORD OPPOSITES TEST 

NAME 

DATE 



Directions ; Pick a word in each line 
which means the opposite or nearly 
the opposite of the numbered word. 
Draw a line under it. 
Example: 1. no oh yes not 



i (PP) 

1. Up 

2. girl (pp) 

3. came (p) 



4. old 



(i) 
(i) 



5. day 

6. town (2_1) 



7. show 

8. softly 

9. earth 



(2-1) 
(2-2) 

(3-1) 



10. master 



(3-2) 



a 

little 

get 

good 

door 

work 

before 

grow 

warm 

. (3-D 

sky 

born 



TEACHER 



iPP) 



dowri 
play 
this 

(i) 

new 
black 

miintr^ 2 "^ 
ready 
wet 
lady 

slave (+) 



,(pp) 



~c — 
you 

happy 

night (1) 
right 



(2-2) 



loudly 
inside 
mad 

SCORE 



(2-2) 



B 



(D 



1. gave 

2. ask (1) 

3. plants (2 - 1) 

4. does (M) 

5. learned (2_2) 

6. sell (2 " 2) 

7. most (2 " 2) 



8. below 



(3-1) 



9. almost C 3 " 1 * 
10. melted (+) 



a 

live 

open 

use 

more 

drink 

hard 

answer 

pour 

hardly ( 3 - 1) 
separate 



(i) 



b 

baby 
te]L (1) 
animals 
summer 
forgot (2 ~ 2 > 
winter ^ 



few 



(3-1) 



above 
close 
_ die 



(2-2) 



took 



(i) 



children 
together 



doesn't 



(2-1) 



pay 



buy. 
sang 
stow 
rainy 
frozen 

SCORE 



(3-1) 



(+) 
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c 




a 


b 


c 


d 


1. 


go ( pp) 


take 


stop (p) 


are 


do 


2. 


ti (2-1) 

I'm 1 ; 


■ (2-1) 

vou're 


dinner 


sell 


nearer 


3. 


... (2-1) 

nothing 1 ; 


crying 


hasn't 


.Spjiifilliing^^glad 


4. 


stands ( - 1} 


high 


summer 


floor 


i |t 1 (2-l) 


5. 


i(2-2) 

great k 


n (2-2) 

small k ; 


moving 


winter 


shouted 


0. 


eany 


remernDereu 


Into (2_2) 


soft 


answer 


7 


hrnkan ( 3-1 ) 
Ui um* n 


UUU 5 


rail i *nc 
Iclui lis 


fixed (3 - 1} 


speak 


8. 


locks (3_2) 


path 


unlocks^ 


fear 


arrives 


9. 


blamed (+) 


waked 


vacation 


lose 


praised (+) 


0. 


kid (+) 


adult (+) 


blazing 


ceiling 


frown 










SCORE 




D 




a 


b 


c 


a 

u 


1. 


sitting (2 - 1 > 


both 


through 


_i__ < i| >% _ (2—1) 

standinq 


larger 


2. 


(2-2) 

rope 1 ; 


string ( ' 


strange 




hurt 


3. 


■ ma ( O — O \ 

brother 2 2) 


dear 


won 


si§t§c (2 ~ 2) 


sound 


4. 


• u (3-1) 

held K ' 


promise 


minds 


whole 


dropped (3_1 


5. 


nlce^ 3-1 ) 


mean (3_1) 


mountains 


bodies 


true 


it 
o. 


StUCK 


fear 


unstuck 


alive 


weak 


7. 


either (+) 


lies 


parent 


neither (+) 


impossible 


8. 


copies (+) 


fancy 


oriqinal (+) 


dryness 


defend 


9. 


groups (+) 


separated 


nurse 


raw 


individuals ( 


0. 


reward (+) 


penalty (+) 


difference 


dull 


occasionally 










SCORE 
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E a bed 

1. behind (2_1) near before (2 " 1} more hungry 

2. quiet {z ~ 2) sound stood grew loud (2 ~ 2) 

3. halft 3 - 1 ) lot drop handful whole (3-1) 

4. vegetables (3 " 1) jneQii (3 " 1) safe inquire thin 

(3-2) (^"2) 

5. stupid explain jmrnl favorite choose 

(3-2) (3~2) 

6. nibble break gobble hollow insist 

7. policeman (+) peace save criminal (h) normal 

8. fortune (+) jewels borrower mlsfbrtune (+) trinkets 

9. native (+) foreigner (+) soak tickled inedible 
10. problems (+) pressing solutions (+) tore healthy 

SCO RE X 

F abed 

1. she's (2_1) does h£s (2_1) you'll hand 

2. spoke (3_1) reach paw noticed listened (2 " 2) 

3. pen (3_2) chief fighting daughter brush ( 3 " 2) 

4. boss (+) employee ( +) strength boomed firmly 

5. modern (+) examine midget antique (+) circular 

6. exhausted (+) purpose energetlc (+) involve charge 

7. prisoner (+) fertile captor (+) cleared mild 

8. firmly ( + ) finally serious weakly (+) vote 

9. gently (+) roughly (+) glide breeze wobbly 

10. valuable (+) collect stir prefer worthless (+) 

SCORE %_ 

- 6 - 
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G 




a 


b 


c 


d 


I. 


mean (3_1) 


fairly 


lovina/ 3 - 1 ) 


ocean 


nine 


2. 


Whisper (3_2) 


nod 


beyond 


_tawJL (3 - 2) 


renew 


3. 


nobody (3 " 2) 


sir 


lettuce 


enter 


somebodvt 3 - 2 ) 


4. 


castle (3_2) 


explain 


cottage ( 3-2 ) 


yesterday 


worried 


5. 


severaK 3-2 ) 


salt 


tale 


nonet 3 - 2 ) 


bundle 


6. 


daughter^ 3-2 ) 


careless 


son ( 3 -D 


insect 


unless 


7 
• • 


pynprt 


utter 


vaaue 


amateur ^ 


co mo ute 


8 


cellar (+) 


tunic 


attic (+) 


herb 


leizure 


9. 


disturb 


host 


bade 


catapult 


soothe (+) 


0 


oreclous ^ 


worthless ^ 


hitch 


violent 


narrow 










SCORE 


% 


H 




a 


b 


c 


d 


1. 


moisture ( +) 


thicket 


dryness ( +) 


resist 


mutter 


2. 


composite (+) 


single ( +) 


compete 


honey 


jade 


3. 


imitate (+) 


increase 


lizard 


create. (+) 


envy 


4. 


abundant (+) 


ruffle 


hostile 


anxious 


scarce (+) 


5. 


tender (+) 


harsh ^ 


trickle 


rubble 


extinct 


6. 


wither (+) 


wit 


flourish (+) 


equip 


resist 


7. 


foreign (+) 


district 


majesty 


tbmestiw (+) 


fossil 


8. 


unique ( + ) 


urban 


similar ( + ) 


chant 


lute 


9. 


reprove (+) 


disrupt 


justice 


request 


praise (+) 


0. perplex ( 


clarify (+) 


stammer 


pearl 


greed 



SCORE 



% 



112 



I a bed 

1. calm (+) tradition hysterical (+) appraise cord 

2. sullen (+) summon herb amjab|e ( ) robust 

3. temporary + ) utter tension permanent ( +) tow 

4. delicate (0 rough ( +) drone majesty robot 

5. horizontal (+) miracle ancestor hoax vertical (H 

6. advantage (+) aloft obstacle (+) logic longitude 

7. fantastic (+) depot finance ordinary (+) navigate 

8. defend (+) emanate duct narrate attack ( +) 

9. proise c+) port reproach (+) gesture kin 

I A (+) ( + ) 

10. ascent jade discus descent vise 

SCORE £ 



9 

ERIC 
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WORD OPPOSITES TEST 

NAME 

DATE 



Pi root i ons : Pick a word in each line 
which me?ans the opposite or nearly 
the opposite of the numbered word. 
Draw a line under it. 



Pynmn 1 p • 1 


n*5 nh vp«? not 


TFAPHFR 






A 


a 


b 


c 




1. up 


little 


down 


you 




2. girl 


get 


play 


boy 




3. came 


good 


this 


went 




4. old 


door 


new 


happy 




5. day 


work 


black 


night 




6. town 


before 


country 


right 




7. show 


grow 


ready 


hide 




o. sonly 


warm 


wet 


loudly 




9. earth 


sky 


lady 


inside 




1 fl MAM t»Wf\ V 

iU. master 


born 


slave 


mad 

SCORE 




B 


a 


b 


C 




1. gave 


live 


baby 


took 




2. ask 


open 


tell 


children 




3. plants 


use 


animals 


together 




4. does 


more 


summer 


doesn't 




5. learned 


drink 


forgot 


pay 




6. sell 


hard 


winter 


buy 




7. most 


answer 


few 


sang 




8. below 


pour 


above 


slow 




9. almost 


hardly 


close 


rainy 




10. melted 


separate 


die 

- 9 - 


frozen 





SCORE 



114 



c 




a 


b 


c 


d 


1. 


go 


take 


stop 


are 


do 


2. 


I'm 


you're 


dinner 


sell 


nearer 


3. 


nothing 


crying 


hasn't 


something 


glad 


4. 


stands 


high 


summer 


floor 


sits 


5. 


great 


small 


moving 


winter 


shouted 


6. 


early 


remembered 


late 


soft 


answer 


7. 


broken 


dad's 


returns 


fixed 


speak 


8. 


locks 


path 


unlocks 


fear 


arrives 


9. 


blamed 


waked 


vacation 


lose 


praised 


0. 


kid 


adult 


blazing 


ceiling 


frown 










SCORE 


% 


D 




a 


b 


C 


d 


1. 


sitting 


both 


through 


standing 


larger 


2. 


rope 


string 


strange 


poor 


hurt 


3. 


brother 


dear 


won 


sister 


sound 


4. 


held 


promise 


minds 


whole 


dropped 


5. 


nice 


mean 


mountains 


bodies 


true 


6. 


stuck 


fear 


unstuck 


alive 


weak 


7. 


either 


lies 


parent 


neither 


impossible 


8. 


copies 


fancy 


original 


dryness 


defend 


9. 


•groups 


separated 


nurse 


raw 


individuals 


10. 


reward 


penalty 


difference 


dull 


occasionally 










SCORE 


X 



- 10 - 



ERIC 



115 



E 




a 


b 


c 


d 


1. 


behind 


near 


before 


more 


hungry 


2. 


quiet 


sound 


stood 


grew 


loud 


3. 


half 


lot 


drop 


handful 


whole 


4. 


vegetables 


meats 


safe 


inquire 


thin 


5. 


stupid 


explain 


smart 


favorite 


choose 


o. 


niDDie 


break 


gobble 


hollow 


insist 


7 


policeman 


peace 


save 


cri minal 


normal 


8. 


fortune 


jewels 


borrower 


misfortune 


trinkets 


9. 


native 


foreigner 


soak 


tickled 


inedible 


10. 


problems 


pressing 


solutions 


tore 


healthy 










score. 




F 




p 


b 


c 


d 


1. 


she's 


does 


he's 


you'll 


hand 


2. 


spoke 


reach 


paw 


noticed 


listened 


3. 


pen 


chief 


fighting 


daughter 


brush 


4. 


boss 


employee 


strength 


boomed 


firmly 


5. 


modern 


examine 


midget 


antique 


circular 




exnausico 


purpose 


energetic 


involve 


charge 


7. 


prisoner 


fertile 


captor 


cleared 


mild 


8. 


firmly 


finally 


serious 


weakly 


vote 


9. 


gently 


roughly 


glide 


breeze 


wobbly 


10. 


valuable 


collect 


stir 


prefer 


worthless 








- u - 
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X 
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n 

u 


h 


r 
\* 


H 

u 


i. 


iiicun 


f ni rl\/ 

iui i iy 


Inuinn 
iuvi i iy 




ni no 
III lie 


0 


Villi ojjcl 


nnH 

1 IUU 


hpvnnrl 


1 ft/ til 


1 cl ICW 


-x 

J. 


i luuuuy 


sir 

Ol 1 


IpttllfP 


pntpr 

C 1 1 IC 1 


juiiicuuuy 


A 


CQSII6 


explain 




I/O eta rrlnv/ 
ycblci UUy 


vwr nea 


c 
P. 


bcvc I Ul 


cnlt 


tnlp 


IIUIIc 


Hi i nrllo 


6 


daughter 


careless 


son 


insect 


unless 


7. 


expert 


utter 


vague 


amateur 


compute 


8. 


cellar 


tunic 


attic 


herb 


leizure 


9. 


disturb 


host 


bade 


catapult 


soothe 


0. 


precious 


worthless 


hitch 


violent 


narrow 










SCORE 




u 

n 




n 
U 


D 


c 


a 


1. 


mAi cf i ira 


XDICKei 


aryness 


resist 


mutter 




ro mnoQitp 


ci nn Ip 
oi i iy ic 


mmnfita 
LUIi^JCle 


Hn now 

nuncy 


jaae 


3 


imitntp 


1 1 ILI GUbC 


li7nrH 

ll£Ul u 


r ran to 
LI cUlc 


envy 


4 


nhi inrinnt 

UUUI IUUI 11 


1 Ul lie 


nubiiit* 


uEiXlvrUb 


sea rce 


5 


tender 


hnr^h 

1 HI 1 Oil 


trirklp 


1 uuuic 


CAll IlLl 


6. 


wither 


wit 


flourish 


eauio 

l r 


resist 


7. 


foreign 


district 


majesty 


domestic 


fossil 


8. 


unique 


urban 


similar 


chant 


lute 


9. 


reprove 


disrupt 


justice 


request 


praise 


10. 


perplex 


clarify 


stammer 


pearl 


greed 










SCORE 
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T 
i 




n 

u 


h 

u 


r 

Is 


H 

u 


i 


mlm 

Mil 


tradition 

11 UVII Vlwl 1 


hvstericnl 


mn rni 


WJI u 




ci illon 


ci i mmnn 

oU III IIIUI 1 




nminhlp 

UIII1UUIC 


I UUUM 




tpmnornrv 

IvIIIUl/l Ul Y 


nftpr 


tension 


nprmnnpnt 


WW 


A 

4. 


delicate 


rough 


drone 


majesty 


robot 


5. 


horizontal 


miracle 


ancestor 


hoax 


vertical 


6. 


advantage 


aloft 


obstacle 


logic 


longitude 


7. 


fantastic 


depot 


finance 


ordinary 


navigate 


8. 


defend 


emanate 


duct 


narrate 


attack 


9. 


praise 


port 


reproach 


gesture 


kin 


0. 


ascent 


jade 


discus 


descent 


vise 



SCORE %. 
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BERKELEY UNIFIED SCHOOL DISTRICT 
CURRICULUM CENTER 

MacMillan 

Word Opposites (Group) Test 
(Grades 3-6) 

ANSWER KEY AND SCORING STANDARDS 

Level Text 

A (1) OPENING BOOKS, A MAGIC BOX 

THINGS YOU SEE, WORLDS OF WONDER 
LANDS OF PLEASURE 



B 


(2-1) 


ENCHANTED GATES 


C 


(2-2) 


SHINING BRIDGES 


D 


(3-1) 


BETTER THAN GOLD 


E 


(3-2) 


MORE THAN WORDS 


F 


(4) 


THE MAGIC WORD 


G 


(5) 


BOLD JOURNEYS 


H 


(6) 


INTO NEW WORLDS 



Scoring Standards 



READING LEVELS 



Free Reading Levels 

(Easy: Pupil can read 
with profit without 
any teacher help.) 

Instruct io nal Levels 

(Suitable: Pupil usually 
needs teacher guidance for 
comprehension and inter- 
pretation) . 

Frustration Levels 

(Too difficult: Pupil 
cannot read with profit 
even with teacher help.) 



No. of words 
correct out 
of 10 



10 

9 



8 
7 



65% - 0 



% of 
accuracy 



100% 
90% 



80% 
70% 



60% - 0 



Prepared by: Russell Saunders, Consulting Teacher 
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mqcjvullan 



MocMILLAN 



WORD 



Directions ; Pick a word in each line 
which means the opposite or nearly 
the opposite of the numbered word. 
Draw a line under it. 



OPPOSITES 

NAME 



TEST 



DATE 



TEACHER 



A 




n 

u 


h 
II 


r 




1 

I. 


MIMA 

come 


wnn 




JP 




0 
£• 


littlp 

IIUIC 


win 

Will 




hln 

oig 






4 It a n 

men 


soon 


ft nH 

lino 


*%A1II 

JE 




4. 


night 


black 


day^ 


sleep 




5 


sits 


rtaht 


best 


stands 




6. 


into 


away 


out 


run 




7. 


took 


from 


tell 


gave 




8. 


over 


after 


back 


under 




9. 


hard 




hurt 


wet 




10. 


yell 


thief 


whisper 


float 

SCORE 




D 
D 




a 


u 


L 


A 

U 


1 

I. 


c a mt nn 

ujiiiing 


y c ui ng 


going 


riQing 


our 


0 


unuci 


awa r 


opened 


TUSi 


ca ma 

some 


J. 


lull 


MAMA 

gone 


Keep 


JjSS» 


siarxeo 


4 


hunarv 




afraid 


yiuu 


full 


C 

5. 


f* III 1 A/1 

puiiea 


pusneg 


poor 


sure 


Kept 


6. 


soft 


ice 


Mi 


wait 


above 


7. 


left 


only 


real 


right 


angry 


8. 


secret 


held 


known 


goodness 


unhappy 


9. 


smart 


top 


fix 


husband 


stupid 


10. 


shiny 


Ml 


fallen 

- 15 - 


ugly 


frowned 








SCORE 


X 



9 
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c 




a 


b 


c 


d 


1. 


front 


buy 


behind 


large 


nothing 


2. 


park 


small 


dark 


rode 




3. 


loud 


sound 


bad 


supper 


quiet. 


4. 


passed 


followed 


stood 


above 


move 


5. 


bottom 


beginning 




plenty 


low 


6. 


lifted 


stretched 


dropped 


lazy 


toward 


7. 


suddenly 


chase 


noisy 


jlqwlv 


wild 


8. 


huge 


terrible 


curled 


tinv 


awful 


9. 


anybody 


nobody 


somebody 


stared 


pointed 


10. 


truth 


truely 




falsely 


different 



SCORE % 



D 




a 


b 


c 


d 


1. 


young 


carried 


JL 


queer 


sorry 


2. 


lead 


against 


child 


follow 


lady 


3. 


broken 


course 


promise 


whole 


smooth 


4. 


weak 


heart 




daughter 


wander 


5. 


enters 


silently 


spread 


leaves 


narrow 


6. 


raised 


heavier 


lowered. 


further 


split 


7. 


beggar 


pioneers 


haul 


aiv.ir 


chuckled 


8. 


future 


easier 




forward 


happily 


9. 


fresh 


stole 


ufjal 


dining 


crispy 


10. 


ashore 


evening 




strode 


surface 



SCORE % 

16 - 
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E 




a 


K 
D 


c 


a 


i. 


retreat 


defeated 


iiDerty 




opposite 


2. 


honor 


tjisarace 


memorial 


statue 


defend 


3. 


calmly 


perfect 


1 MUM M jj 


exciiefliv 


shoved 


4. 


accept 


ourselves 


metal 


superman 


reiect 


5. 


cruel 


fonder 


tiusnea 


meant 


DOLKjUet 


0. 


entrance 


warrior 




OlTICc 


noiipon 


7 


miserable 


deaend 


orooer 


comfortable 


serious 


8. 


wrinkled 


yourselves 


pressed 


uniform 


military 


9. 


strength 


carrots 


realize 


expensive 


weakness 


10. 


wealth 


poverty 


freedom 


success 


usable 










SCORE % 


F 




a 


b 


c 


d 


i. 


capture 


native 


jjejgajse^ 


amaze 


foresight 


2. 


waste 


entire 


belief 


pinch 


save 


3. 


mild 


support 


tenderness 


husky 


harsh 


4. 


ft 

firm 


jge^je. 


strict 


mood 


unfair 


5. 


regular 


somewhat 




venture 


paddle 


6. 


Increase 


tradition 


lessen 


spout 


banner 


7. 


tough 


twitch 


pretend 


froil 


lei 


8. 


dent 


cane 


rifle 


bulae 


shrug 


9. 


sloppy 




windshield 


juggler 


mound 


10. 


patient 


clue 


restless 


cricket 


editor 



SCORE % 
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G 




a 


b 


c 


d 


L 


mabritv 


mammoth 


minority. 


occur 


force 


2 


pynnnri 


nntipncs 

Vi VI VI v 1 Svw 


insoect 

III tJUvWI 


contract 


reserve 


3 


nrnvifto 




elect 


denv 
i Trill 


stubborn 


4. 


tense 


shock 


[relaxed 


qrowi 

■ w WW ■ 


limit 


5 


attemot 


auolitv 


product 


avoid 


accident 


6. 


hollow 


cannon 


snliri 


disk 


beacon 


7 


Uvi law 


cleat 


convince 

W 11*11 IVv 


j s_aj_f^, 


butler 


8. 


spectator 


season 


outfit 


jejjmjg^ 


curse 


9. 


perish 




famine 


trance 


gait 


10. 


coil 


civics 


unwind 


granite 


jog 










SCORE % 


H 




n 

u 


b 


c 


d 


1 


infinite 

1 1 II 1 1 II %w 


ianeous 


limited 


gauge 


evolve 


2. 

— * 


hnnrilcnn 




lithe 

1 1 %l IW 


synthetic 


wretched 


3 


trivial 


neaative 


electrode 

V 1 V* W \ 1 Www 


important 


careen 


4 


critical 

VI IMVUI 


subtle 


conservative 


dilute 


approving 


5 


romantic 


aractical 


muzzle 

III UfcCilV 


precise 


isolate 


Q. 


UU 311 Uvl 


fa rat* 
iui ye 


nccict 


anticipate 


palpitate 


7. 


ascend 


astern 


traveler 


descend 


haven 


8. 


popular 


outrageous 


disliked 


accord 


propel 


9. 


certain 


climax 


cylinder 


shutter 


doubtful - 


10. 


distribute 


jfljjjej^ 


gauge 


beaker 


radar 



SCORE X 
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MacMILLAN MacMlLLAN 
WORD OPPOSITES TEST 

Directions ; Pick a word in each line NAME 

which means the opposite or nearly 

the opposite of the numbered word. DATE 



Draw a line under it. 

Example: 1. no oh yes not TEACHER 



A 




a 


b 


c 




1. 


come 


with 


go 


up 




2. 


little 


will 


you 


big 




3. 


then 


soon 


find 


now 




4. 


night 


black 


day 


sleep 




5. 


sits 


right 


best 


stands 




6. 


into 


away 


out 


run 




7. 


took 


from 


tell 


gave 




8. 


over 


after 


back 


under 




9. 


hard 


soft 


hurt 


wet 




1 A 

10. 


yell 


11 • ^£ 

thief 


whisper 


float 












SCORE 




B 




a 


b 


c 


d 


1. 


coming 


getting 


going 


riding 


our 


2. 


under 


over 


opened 


fast 


some 


3. 


tail 


gone 


keep 


head 


started 


4. 


hungry 


cried 


afraid 


glad 


full 


5. 


pulled 


pushed 


poor 


sure 


kept 


6. 


soft 


ice 


hard 


wait 


above 


7. 


left 


only 


real 


right 


angry 


8. 


secret 


held 


known 


goodness 


unhappy 


9. 


smart 


top 


fix 


husband 


stupid 


10. 


shiny 


dull 


fallen 


ugly 


frowned 
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c 




a 


b 


c 


d 


1. 


front 


buy 


behind 


large 


nothing 


2. 


park 


small 


dark 


rode 


drive 


3. 


loud 


sound 


bad 


supper 


quiet 


4. 


passed 


followed 


stood 


above 


move 


5. 


bottom 


beginning 


top 


plenty 


low 


6. 


lifted 


stretched 


dropped 


lazy 


toward 


7. 


suddenly 


chase 


noisy 


slowly 


wild 


8. 


huge 


terrible 


curled 


tiny 


awful 


9. 


anybody 


nobody 


somebody 


stared 


pointed 


in 
IU. 


4ri itk 

trutn 


trueiy 


lies 


falsely 


ai tie rent 










SCORE 


% 


D 




a 


b 


c 


d 


1. 


young 


carried 


old 


queer 


sorry 


2. 


lead 


against 


child 


follow 


lady 


3. 


broken 


course 


promise 


whole 


smooth 


4. 


weak 


heart 


strong 


daughter 


wander 


5. 


enters 


silentfv 


spread 


leaves 


narrow 


6. 


raised 


heavier 


lowered 


further 


split 


7. 


beggar 


pioneers 


haul 


giver 


chuckled 


8. 


future 


easier 


past 


forward 


happily 


9. 


fresh 


stale 


usual 


dining 


crispy 


10. 


ashore 


evening 


afloat 


strode 


surface 



SCORE % 
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E 




a 


b 


c 


d 


| 


retreat 


defeated 


liberty 


advance 


oDDOsite 


2 


honor 


di sa race 


memorial 


statue 


defend 


3. 


calmly 


perfect 


inward 


excitedly 


shoved 

*# « IW V w VI 


4. 


accept 


ourselves 


metal 


superman 


reject 


5. 


cruel 


tender 


flushed 


meant 


bouquet 


6. 


entrance 


warrior 


exit 


office 


heliport 


7. 


miserable 


depend 


proper 


comfortable 


serious 


8. 


wrinkled 


yourselves 


pressed 


uniform 


military 


9. 


strength 


carrots 


realize 


expensive 


weakness 


10. 


wealth 


poverty 


freedom 


success 


usable 










SCORE % 


F 




a 


b 


c 


d 


1. 


captu re 


native 


release 


amaze 


foresight 


2 


waste 


enti re 


belief 


pinch 


save 


3. 


mild 


SUDDOrt 


tenderness 


husky 


harsh 


4. 


firm 


feeble 


strict 


mood 


unfair 


5. 


regular 


somewhat 


odd 


venture 


paddle 


0. 


1 lit I cube 


irauiuon 


lessen 


spout 


banner 


7. 


tough 


twitch 


pretend 


frail 


lei 


8. 


dent 


cane 


rifle 


bulge 


shrug 


9. 


sloppy 


neat 


windshield 


juggler 


mound 


10. 


patient 


clue 


restless 


cricket 


editor 



SCORE % 
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G 




a 


b 


c 


d 


1. 


majority 


mammoth 


minority 


occur 


force 


2. 


expand 


patience 


inspect 


contract 

■ ■ % ■ VIV % 


reserve 


3. 


provide 


enerav 


elect 


deny 


stubborn 


4. 


tense 


shock 


relaxed 


growl 


limit 


5. 


attempt 


quality 


product 


avoid 


accident 


6. 


hollow 


cannon 


solid 


disk 


beacon 


7. 


dense 


cleat 


convince 


sparse 


butler 


8. 


spectator 


season 


outfit 


performer 


curse 


9. 


perish 


survive 


famine 


trance 


gait 


10. 


coil 


civics 


unwind 


granite 


jog 










SCORE 




H 




a 


b 


c 


d 


I. 


infinite 


igneous 


limited 


qauqe 


evolve 


2. 


handicap 


advantage 


lithe 


synthetic 


wretched 


3 


trivial 


neaative 


electrode 

Wlvvll W Uw 


imoortant 


careen 


4 


critical 


subtle 


conservative 


dilute 


QDProvi na 


5 


romantic 


oractical 


muzzle 

III \mmmMm 1 V 


precise 


isolate 


A 


nhctn \c\ 

UUMI UlA 






nntirinntp 


nnlnitntp 


7. 


ascend 


astern 


traveler 


descend 


haven 


8. 


popular 


outrageous 


disliked 


accord 


propel 


9. 


certain 


climax 


cylinder 


shutter 


doubtful 


10. 


distribute 


gather 


gauge 


beaker 


radar 



SCORE % 
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BERKELEY UNIFIED SCHOOL DISTRICT 
Curriculum Center 
841 Folger 



WORD RECOGNITION TEST CARDS 

FOR 

Pages 

Bank Street Readers 1-3 
Harper & Row Basic Readers 4-6 
The MacHillan Reading Program (Harris) 7-9 
Scott, Foresman OPEN HIGHWAYS Readers 10 



GENERAL DIRECTIONS 

The word cards in this booklet are to be read by the pupil. 

Record pupil responses on a separate WORD RECOGNITION SCORING SHEET. 
Use a separate sheet for each pupil tested* 



SCORING DIRECTIONS 

Refer to the directions on the WORD RECOGNITION SCORING SHEET for 
directions for recording pupil responses . 

Determine reading levels described below by using the following 
percentage scores: 



FREE READING LEVELS 
(Easy: Pupil can read 
with profit without 
any teacher help.) 

INSTRUCTIONAL LEVELS 
(Suitable: Pupil usually 
needs teacher guidance for 
comprehension and inter- 
pretation.) 



No. of words 
correct out 
of 20 

20 
19 



18 
17 
16 
15 
14 



% of 
accuracy 



100% 
95% 



90% 
85% 
80% 
75% 
70% 



FRUSTRATION LEVELS 
(Too difficult: Pupil 
cannot read with profit 
even with teacher help.) 



13-0 



65% - 0% 
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BANK BANK BANK 

WORD RECOGNITION TEST-- (Card I) 

A B C 



house 
street 

go 

they 
school 



but 

me 

his 

drill 

rained 



faster 

lap 

first 

place 

opened 



on 

morning 
say 
who 
is 



grandmother 

said 

cat 

gave 

win 



noisy 

faraway 

things 

door 

tried 



at 

she 
have 
yes 
stop 

ice cream 

trucks 

fireman 

birds 

free 



your 

no 

fell 

walked 
way 

lived 

snowplow 
wanted 
highways 
rolled 



black 

today 

each 

safe 

we're 

backward 

alike 

share 

hole 

bread 
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BANK BANK BANK 

WORD RECOGNITION T E S T - -( Card 2) 

D E F 

soon quite closes 

while which core 

animals tomatoes bother 

bed mouth burning 

nine scare wrinkled 

terrible licked person 

friendly squeaky bank 

fish babies goodness 

castle palace rhymes 

roared deep future 

teeth seal happiness 

cracks brought tasted 

snowf lakes suddenly needle 

loose rode shopped 

stay been gulls 

mice butterflies fairies 

games returning wedding 

cloud traveler wandering 

crazy added fifty 

grade stony branches 
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BANK BANK BANK 

WORD RECOGNITION T E S T - - (Card 3) 



shivered 
forts 
minute 
tag 

screens 

pigeons 

also 

exactly 

ink 

shrill 

pilot 

pair 

flipped 

fair 

stall 

creep 

starve 

muddy 

tease 

slapped 
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HARPER HARPER HARPER 
WORD RECOGNITION TEST - - (Card I) 

* 

A B C 

and play him 

here now girl 

I do of 

can red dime 

go going give 

the at skates 

socks too bed 

in morning why 

two said pond 

Mother your brown 

Daddy will sun 

with big by 

to what legs 

you he colt 

want did sheep 

have fly feel 

like old door 

good town talk 

a someone football 

make tell show 
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HARPER HARPER HARPER 
WORD RECOGNITION TEST - - (Card2) 

D E F 

hark teacher soon 

around each doghouse 

start names hero 

called ourselves wrong 

wanted stripes lake 

find arithmetic locks 

zoo been turn 

when finger pays 

himself nails kid 

trip drink goal 

young believe slippers 

warm stopped breakfast 

peeped always gave 

an flowers piled 

under store whiskers 

dry food hope 

patted land danced 

spell five tulips 

black leave since 

knew lamps prize 
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HARPER HARPER HARPER 

WORD RECOGNITION TEST — (Card3) 



G 


H 


I 


C I 7P 
5 1 £U 


r Pn 1 1 v 
i cu 1 1 y 


n n v p 1 


n ii r cp 

II U 1 jw 


r n 1 1 n n p 
iu 1 1 u y c 


c t i r 
bill 


UOX n 


x ex c i ui ine a 


no xi ce a 


n o n n \i 


♦ ft ui n r H 
10 WU 1 U 


lop 


often 


Mama 


depend 


s xa xe 


i n o u g n x 


m i c rooe s 


h 1 a r 1/ r 

u IOC KS 


mi 1 ft ft la f\ 

wi 99 ie a 


xwi stea 


fur 

1 Ul 


n i c t ft m 
tU b IU III 


f r P P t P r 


h o n r H 
11 C U 1 U 


x i g c r 


1 a rnt aH 

i o cax e a 


spend s 

r 


lots 


graceful 


n n f to rc 

U II UC 1 b 


h ft ft n c 
IIU U \) b 


c p i* i/ p A 
5 c r V c u 


h ro t h p r 


drown 

U 1 v VI II 


h ft r H P r c 


^ ii m 

J> U III 


kettle 

It w I I 1 w 


c p n n ft r t 


1 CU jU II 


hp n r t c 

IICUI 15 


cunnPctpH 
b uy y c b i c u 


buzzed 


janitor 


frame 


castle 


tore 


1 paw 


met 


protect ing 


pebble s 


shall 


creaki ng 


tug 


waltz 


carving 


domes 


impossible 


magazi nes 


throat 
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Mac Mi 1 1 an MacMillan MacMillan 



WORD 


RECOGNITION TEST - 


- (Cardl) 


A 
r\ 


R 


r 


una 


tin 

up 


we 


rides 

l 1 VI v 9 


here 

llv 1 w 


n i c n i r 


who 

If 1 1 u 


an 


n nn H 
y uu u 


con 

vU II 


didn't 

VI 1 VI 1 1 I 


ho ii n rp 

UU U II 


with 

IV 1 III 


so me t h i n a 

ju II iv vim it y 


run 

lull 


policemen 


ran 


oh 


p n n 1 1 

vU II 1 


r o m p 

V» w ill V? 


tricks 

11 1 v» r\ 9 


t hp 


jfw U 


hue 

UU) 


n 1 a \# 
p iuy 


D n ririv 

l/UUUjf 


m n n 

IN U II 


^n i ri 


r a m p c 

V* Vl III v 9 


talk 


I 


£ _ 

for 


my 


ball 


mo ke s 

. 1 1 1 VI l\w J 


liaht 

i i yj ii i 


aet 


like 


t h rpp 

1 1 1 1 w w 


wn nt 

If VI 1 1 % 


vp 1 Inw 


i ii s t 


to 


loo ks 

1 VV llw 


loo ked 


cowboys 


ye s 


fro m 


a 


see 


hurry 


bike 


boy 


word 


not 


green 


flew 


i s 


stop 


peanuts 
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MacMillan MacMillan MacMillan 

WORD RECOGNITION TEST - - (Card2) 



D 


E 


F 


street 


getting 


printing 


liked 


outside 


watched 


cry 


keep 


everybody 


six 


oldest 


fourth 


yelling 


lib rary 


voice 


togethe r 


I'm 


playful 


puppy 


sugar 


language 


next 


kite 


squi rrel 


came 


hobby 


reache d 


last 


soft 


group 


old 


tail 


pour ing 


bone 


cellar 


awful 


fair 


good ne ss 


wrong 


mad 


dance 


acti ng 


people 


popped 


post 


horse 


spring 


paw 


noise 


almost 


often 


mountai n 


fires 


tracks 


meow 


left 


snake 


kind 


trip 


bottom 
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MacMi Han 



MacMiMan 



Mac Mi Man 



WORD RECOGNITION TEST - - (Card 3) 
G H 



attention 


electri c 


board 


app rove 


mi nute 


rushed 


farther 


calmly 


sighed 


alphabet 


dislike 


tangled 


trotted 


teammates 


cottages 


glanced 


gentle 


raccoons 


explode 


recognize 


supports 


slanted 


i nvented 


entrance 


haul 


seize 


marry 


trout 


ci der 


guards 


saucepan 


amazing 


gowns 


mi stakes 


fruit 


harbor 


queer 


p rotect 


immediately 


eagle 
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OPEN HIGHWAYS OPEN HIGHWAYS OPEN HIGHWAYS 



WORD 


RECOGNITION TEST - 


- (Cardl) 


A 


B 


C 


rack 


dumped 


messy 


bottle cap 


toothpick 


sparkling 


ho rsecar s 


fought 


bathrobe 


fi reworks 


jailer 


press 


bet 


stroked 


thief 


grip 


tend 


unco mbed 


pal 


lack 


shaggy 


steep 


frog 


remained 


pill 


wherever 


eyelashes 


spa rks 


creep 


armored 


failed 


sink 


team 


ki ngdom 


frozen 


resist 


fluff 


main 


dinosaurs 


slide 


drum 


dozen 


frame 


beaks 


clutching 


date 


he m 


correct 


sport 


fin 


strictly 


fed 


hike 


concerned 


sneeze 


cannon 


spoiled 


rose 


pest 


reptiles 
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BANK BANK BANK 

WORD RECOGNITION SCORING SHEET 

Directions: Use the following codes in Pupil 

response columns: 

correct word ^ Date 

sibs£itHtiof 10n ) (write word said > Instructional levels 

refusal (after 5 seconds) R 

To get percentage of accuracy 
multiply number of errors by 5 

and deduct total from 100. Teacher 



A (Pre-Primer) B (Primer) c (First) 



1. 


house 


but 


faster 


2. 


street 


me 


lap 


3. 


go 


his 


first 


4. 


they 


drill 


place 


5. 


school 


rained 


opened 


6. 


on 


grandmother 


noisy 


7. 


morning 


said 


faraway 


8. 


say 


cat 


things 


9. 


who 


gave 


door 


10. 


is 


win 


tried 


11. 


at 


your 


black 


12. 


she 


no 


today 


13. 


have 


fell 


each 


14. 


yes 


walked 


safe 


15. 


stop 


way 


we're 


16. 


ice cream 


lived 


backward 


17. 


trucks 


snowplow 


alike 


18. 


fireman 


wanted 


share 


19. 


birds 


highways 


hole 


20. 


free 


rolled 


bread 


Srnr* % 


Score 


% Score - 



% 



In the City Around the City Uptown , Downtown 

People Read 
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FRIC 



BANK 



BANK 



BANK 



D (Second - 1) 



1. 

2. 

3. 

4. 

5. 

6. 

7 . 

8. 

9. 
10. 
11. 
12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
20. 



soon 

while 

animals 

bed 

nine 

terrible 

friendly 

fish 

castle 

roared 

teeth 

cracks 

snowflakes 

loose 

stay 

mice 

games 

cloud 

crazy 

grade 



E (Second -2) 

quite 

which 

tomatoes 

mouth 

scare 

licked 

squeaky 

babies 

palace 

deep 

seal 

brought 

suddenly 

rode 

been 

butterflies 

returning 

traveler ^_ 

added 

atony 



F (Third - 1) 

closes 

core 

bother 

burning 

wrinkled 

person 

bank 

goodness 

rhymes 

future 

happiness 

tasted 

needle 

shopped 

gulls 

fairies 

wedding 

wandering 

fifty 

branches 



Score 



Mv_ City 



Score 



Green Light , Go 



SCORE 



City Sidewalks 
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BANK 



G 


(Third - 


i . 


shivered 


2. 


forts 


3. 


minute 


4. 


tag 


5. 


screens 


6. 


pigeons 


7. 


also 


8 . 


exactly 


9. 


ink 


1^ . 


shrill 


11 . 


pilot 


12. 


pair 


13. 


flipped 


14. 


fair 


15. 


stall 


16. 


creep 


17. 


starve 


18. 


muddy 


19. 


tease 


20. 


slapped 



SCORE 



Round the Corner 
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HARPER HARPER 

WORD RECOGNITION SCORING SHEET 



HARPER 



Diroctiuas: Use the following codes in 
response columns: 

/ 



correct: word 



mispronunciation) / , 

,* . . < (write word said) 

substitution ) N 

refusal (after 5 seconds) 



R 



To get percentage of accuracy 
multiply number of errors by 5 
and deduct total from 100. 



Pupil 



Date 



Instructional Levels 



Teacher 



A (Pre-PrimerslarKl2) 



B (Pre-Primers 3 and 4) C (Primer) 



Janet and Mark 
Outdoors and In 



1 . 


and 


play 


him 


i. • 


here 


now 


girl 


3 . 


T 


do 


of 


4. 


can 


red 


dime 


5. 


go 


going 


give 


6. 


the 


at 


skates 


7. 


socks 


too 


bed 


8. 


in 


morning 


why 


9. 


two 


said 


pond 


10. 


Mother 


your 


brown 


11. 


Daddy 


will 


sun 


12. 


with 


big 


by 


13. 


to 


what 


legs 


14. 


you 


he 


colt 


15. 


want 


did 


sheep 


16. 


have 


fly 


feel 


17. 


like 


old 


door 


18. 


good 


town 


talk 


19. 


a 


someone 


football 


20. 


make 


tell 


show 


Score 


Score 


Score 

% 



City Days , City Ways 
Just for Fun 



Around the Corner 
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HARPER 



HARPER 



HARPER 



D (First-I) 

1. hark _ 

2 . around 

3. start 

4. called 

5. wanted 

6. find _ 

7. zoo 

8. when _ 

9. himself 

10. trip _ 

11. young 

12. warm 

13. peeped 

14 . an 

15. under 

16. dry _ 

17. patted _ 

18. spell _ 

19. black 

20. knew 



E (First -2) 



F (Second-I) 



Score 



teacher 

each 

names 

ourselves 

stripes 

arithmet ic 

been 

finger 

nails 

drink 

believe 

stopped 

always 

flowers 

store 

food 

land 

five 

leave 

lamps 

Score 



soon 

doghouse 

hero 

wrong 

lake 

locks 

turn 

pays 

kid 

goal 

slippers 

breakfast 

gave 

piled 

whiskers* 

hope 

danced 

tulips 

since 

prize 



Score 



% 



Real and Make-Believe 



From Elephants to 
Eskimos 



All Through the Year 



38 
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HARPER 



HARPER 



HARPER 



G 


(Second-2) 




H (Third-I) 


I (Third-2) 


i. 


size 




really 


gavel 


2. 


nurse 




cottage 


stir 


3. 


both 




exclaimed 


noticed 


4. 


penny 




toward 


lap 


5. 


often 




Mama 


depend 


6. 


state 




thought 


microbes 


7. 


blocks 




wiggled 


twisted 


8. 


fur 




custom 


freezer 


9 . 


heard 




tiger 


located 


10. 


spends 




lots 


graceful 


11. 


antlers 




hoops 


served 


12. 


brother 




drown 


borders 


13. 


sum 




kettle 


seaport 


1 A 


rpason 




hearts 


suggested 


15. 


buzzed 




Jan it or 


frame 


16. 


castle 




tore 


paw 


17. 


met 




protecting 


pebbles 


18. 


shall 




creaking 


tug 


19. 


waltz 




carving 


domes 


20. 


impossible 




magazines 


throat 




Score 


% 


SCORE 


% SCORE 




From Fins to Feathers 


From Faraway Places 


From Bicycles to 



% 



Boomerangs 



39 
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MacMillan MacMillan MacMillan 

WORD RECOGNITION SCORING SHEET 

Directions: Use* the following codes in 
response columns: 

correct wore) Y 



mispronunciation) 

substitution ) (write word said) 
refusal (after 5 seconds) R 



To get percentage of accuracy 
multiply number of errors by 5 
and deduct total from 100. 

A (Pre-Primer 1) B(Pre-Primers2and3) C (Primer) 



Pupil 

Date 

Instructional Levels 

Teacher 



1 . and 


up 


we 


2. rides 


here 


picnic 


3 . who 


go 


good 


4. can 


didn T t 


bounce 


5. with 


something 


run 


t> . pol icemen 


ran 


oh 


7. can't 


come 


tricks 


8. the 


you 


bus 


9. play 


Daddy 


man 


10. said 


comes 


talk 


11. I 


for 


my 


12. ball 


makes 


light 


13. get 


like 


three 


14. want 


yellow 


just 


15. to 


looks 


looked 


16. cowboys 


yes 


from 


17. a 


see 


hurry 


18. bike 


boy 


word 


L9 . not 


green 


flew 


20 . is 


stop 


peanuts 


Score % 


Score 


% Score 



Opening Books A Magic Box Worlds of Wonder 

Things You See 
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MacMi I Ian 



MacMillan 



MacMillan 



D(Fi rst - I) 

1 . .street 

2. Likud 

.'t . e ry 

4 . six 

5, yelling 
(>. together 

7 . puppy 

8 . next 

9 . came 

10. last 

11. old 

I '2 . bone 

13. fair 

14 . mad 

15. people 

16. horse 

17. noise 

18. mountain 

19. meow 

20 . kind 



E (Second-I) 



getting 

outside 

keep 

oldest 

library 

I'm 

sugar 

kite 

hobby 

soft 

tail 

cellar 

goodness 

dance 

popped 

spring 

almost 

fires 

left 

trip 



F (Second-2) 

printing 

watched 

eve ry body 

fourth 

voice 

pi ay f ul 

language 

squirrel 

reached 

group 

pouring 

awful ' 

wrong 

acting 

post 

paw 

often 

tracks 

snake 

bottom 



Score 



Sco re 



% 



Score 



Lands of Pleasure 



Enchanted Gates 



S hining Bridges 
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MacMillan . MacMillan MacMillan 

G (Third-I) H (Third-2) 



L. 


attention 


electric 


2 » 


board 


approve 


;i , 


minute 


rushed 


4, 


farther 


calmly 


5. 


sighed 


alphabet 


6. 


(J is! ike 


tangled 


7. 


trotted 


teammates 


8. 


cottages 


glanced 


9. 


gentle 


raccoons 


10. 


explode 


recognize 


11. 


supports 


slanted 


12 . 


XI 1 VC1II.CU 




13. 


haul 


seize 


14. 


marry 


trout 


15. 


cider 


guards 


16. 


saucepan 


amazing 


17. 


gowns 


mistakes 


18. 


fruit 


harbor 


19. 


queer 


protect 


20. 


immediately 


eagle 



Score % Score % 



Better than Gold More than Words 
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OPEN HIGHWAYS 
Book 4 



OPEN HIGHWAYS 
Book 4 



OPEN HIGHWAYS 
Book 4 



WORD RECOGNITION SCORING SHEET 



Directions: Use the following codes in 
response column.'?: 

v 



correct: word 



misprounc iation) 

substitution ) (write word said) 
refusal (after 5 seconds) R 

To get percentage of accuracy 
multiply number of errors by 5 
and deduct total from 100. 



Pupil 



Date 



Instructional Levels 



Teacher 



A 




B 




r 


i. 


rack 


dumped 




messy 


2 


bottle cap 


toothpick 




sparkling 


3 . 


horse cars 


fought 




bathrobe 


4. 


fireworks 


jailer 




press 


5 . 


bet 


stroked 




thief 


(>. 


grip 


tend 




uncombed 


7. 


pal 


lack 




shaggy 


8. 


steep 


frog 




remained 


9. 


pill 


wherever 




eyelashes 


10. 


sparks 


creep 




armored 


11. 


failed 


sink 




team 


12. 


kingdom 


frozen 




resist 


13. 


fluff 


main 




dinosaurs 


14. 


slide 


drum 




dozen 


15. 


frame 


beaks 




clutching 


16. 


date 


hem 




correct 


17. 


sport 


fin 




strictly 


IB. 


fed 


hike 




concerned 


19. 


sneeze 


cannon 




spoiled 


20. 


rose 


pest 




reptiles 




Score % 


Score 


% 


Score 




(Sections 1 and 2 
Pages 9..- 139 
R.L. 2--2 ~ Z ) 


(Sections 3-5 
Pages 140-371 
R.L. 3*" 1 - 3"" Z ) 




(Section 
Pages 3X 
R.L. 3 . 
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The Problem 

New textbooks in reading were adopted for use in 
California elementary schools beginning with the 1969-70 
school year. Three collections of textbooks were adopted for 
culturally disadvantaged, slow, average, and fast student 
groups. The vocabulary in the collections had been studied 
and described in subjective, rather than objective terms. 
No readability data had been secured by means of formula 
application. Therefore, the purpose of this study was to 
determine if there was a significant difference in the read- 
ability of reading textbooks adopted for four student groups. 

Methods and Procedures 

The Botel readability formula, contained in Predict- 
ing Reading Levels , was applied to nine, 100-word samples 
taken from a total of twenty-four textbooks. The sign test 
for significant differences was applied in an inter -textbook 
comparison of readability levels of each of the nine samples 
across the three collections. The data were inspected, 
further, to determine intra-textbook variations in read- 
ability levels among the nine samples. 

The interquartile range (Q3 -Q^) was calculated for 
each of the nine, 100-word samples taken from the twenty- 
four textbooks. The data were inspected to determine if 
there was a difference in the range of readability levels of 



the textbooks in a comparison among the three collections. 
The sign test for significant differences was applied, a 
second time, in an inter -textbook comparison of the inter- 
quartile ranges. 

Findings 

Readability levels of textbooks, adopted for cultu- 
rally disadvantaged students, were significantly lower than 
readability levels of textbooks adopted for slow and average 
students in grades one, two, and three, in three of the five 
comparisons made. 

Readability levels of textbooks, adopted for slow 
and average students, were significantly higher than text- 
books adopted for fast students in grades one, two, and 
three, in two of the five comparisons made. 

The readability level of the fifth-grade textbook, 
adopted for culturally disadvantaged and slow students, was 
significantly lower than the readability level of the text- 
book adopted for the fast students. 

Textbooks, adopted for fast students, achieved the 
best publishers grade assignment — readability level, match. 
Additional variations in readability levels were observed 
within the nine samples in each of the twenty-four textbooks. 

The interquartile range of the nine samples increased 
appreciably, starting at the third reader, part two level # 



but no significant differences were obtained in interquartile 
ranges when comparisons were made among the three collections. 
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